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THE x? TEST OF GOODNESS OF FIT! 
By WiiuraM G. CocHran 
Johns Hopkins University 


1. Summary. This paper contains an expository discussion of the chi square 
test of goodness of fit, intended for the student and user of statistical theory 
rather than for the expert. Part I describes the historical development of the 
distribution theory on which the test rests. Research bearing on the practical 
application of the test—in particular on the minimum expected number per 
class and the construction of classes—is discussed in Part II. Some varied 
opinions about the extent to which the test actually is useful to the scientist 
are presented in Part III. Part IV outlines a number of tests that have been 
proposed as substitutes for the chi square test (the w test, the smooth test, 
the likelihood ratio test) and Part V a number of supplementary tests (the run 
test, tests based on low moments, subdivision of chi square into components). 


2. Introduction. In the standard applications of the test, the n observations 
in a random sample from a population are classified into k mutually exclusive 
classes. There is some theory or null hypothesis which gives the probability 
p; that an observation falls into the ith class (¢ = 1, 2, --- , k). Sometimes the 
p; are completely specified by the theory as known numbers, and sometimes 
they are less completely specified as known functions of one or more parameters 
a, @,°*-* Whose actual values are unknown. The quantities m; = np; are 
called the expected numbers, where 


k 
pai hy 
tal t=l 
The starting point in the theory is the joint frequency distribution of the 
observed numbers 2; falling in the respective classes. If the theory is correct, 
these observed numbers follow a multinomial distribution with the p; as proba- 
bilities. The joint distribution of the x; is therefore specified by the probabilities 


n! zi ze qr, 
(1) malate mie ve * 


As a test criterion for the null hypothesis that the theory is correct, Karl 
Pearson [1] proposed the quantity 


2 > (1, — m )? > x 
(2 X* = —___— = + —n. 
) im Mm i=l M; 
1 Department of Biostatistics Paper No. 282. 
Editor’s Note: This paper was presented to the Boston meeting of the Institute 
of Mathematical Statistics, December 28, 1951, and is published in the Annals by invitation 
of the Institute Committee on Special Invited Papers. 
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Pearson did not mention any particular alternative hypothesis. The test has 
usually been regarded as applicable to situations in which the alternative hy- 
pothesis is described only in rather vague and general terms. 

As with any test of a hypothesis, certain properties of the test must be worked 
out before it is ready for practical application. We need to know the frequency 
distribution of the test criterion when the null hypothesis is correct, in order 
that tables of significant values can be constructed. As much as possible should 
also be known about the performance of the test when the null hypothesis 
does not hold. Practically all the results in the literature deal only with the 
limiting distribution of X° as n — ~, the p; remaining fixed. When the null 
hypothesis holds, this limiting distribution is the x’ distribution, 


ae (gee at 
" ( - 1)! 


(3) 


where v is the number of degrees of freedom in x’. This distribution is also 
known to be that followed by the quantity 


vityete ty, 
where the y; are normally and independently distributed with zero means and 
unit variances. 
To avoid confusion, the symbol X° will be used for the quantity in equation 
(2) which is calculated from the data when a chi square test is performed. The 


symbol x’ will refer to any random variate which follows the tabular chi square 
distribution given in (3). 


Part I. HistoricAL DEVELOPMENT OF THE TEST 


3. Karl Pearson’s 1900 paper. This remarkable paper is one of the foundations 
of modern statistics. Its style has always impressed me as unusual for a pioneer- 
ing paper. Pearson writes with the air of a man who knows exactly what he is 
doing. The exposition, although clear, is slightly hurried and brusque, as if the 
reader will not wish to be troubled by elaborate details of a problem that is 
routine and straightforward. One misses any discussion of how Pearson came 
to choose the X? test criterion, and of when he first came to realize that this 
criterion would, under certain circumstances, follow the x? distribution. 

The paper opens by proving that if a set of v correlated variates z; , with zero 
means, follow a multivariate normal distribution 


Ce? dzidzo oes dz, . 


then the quadratic form Q is distributed as x’ with » degrees of freedom. This 
proof is accomplished, in about half a page, by a now familiar geometrical 
argument. Pearson points out that the ellipsoid Q can be “squeezed” into a 
sphere. A transformation to polar coordinates is made, where x is the radius 
of the sphere and Q = x’. He then remarks that all the angles introduced in 
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the transformation will integrate out to a constant factor, so that the proba- 
bility that Q exceeds xj , say, reduces to 


r 2 
/ e* ” Sie dx 
xo 


[ ey! dx 
0 


This, of course, is the tabular x’ distribution, expressed as an integral of x 
rather than x’. The result is a generalization of the result reached by Helmert 
in 1876, and also of the result which Student later developed in 1908 as ground- 
work for the ¢-distribution. 

The next step is to express the probability integral in power series form, 
this being necessary to construct a table of the probability integral. The paper 
contains a table giving P to 6 decimal places, for degrees of freedom from 2 
to 19, and for various integral values of x’. 

Pearson now turns to the problem of testing goodness of fit. He deals first 
with the case in which the expectations m; are known numbers. The data have 
been classified as described in Section 2, so that the observations zx; follow a 
multinomial distribution. Pearson assumes without more ado that the x; may 
be taken as normally distributed. It is at this point, therefore, that he is com- 
mitted to the assumption that the expectations m; are large in all cells. He 
assigns to the x; their correct variances and covariances from the multinomial 
distribution, that is, 


(4) ‘= npi(1 = Pi); oij = —NDPiP; 1G # D) 


The remainder of the proof consists in writing down the presumed multi- 
variate normal distribution of the quantities (x; — m;). From this comes the 
pleasing result that the quadratic form Q in the exponent is simply 


Q= > & ess mi)* a 3 
= ee » 


This may be shown as follows. Since the x; are constrained to add to n, we 
must omit one of them, say x; , in considering their joint distribution. If the 
joint frequency functien of the first (k — 1) of the 2’s is Ce? it is well known 
that 


k—1 k-i 
Q=L dL ox, — mi)(x; — m,), 
t=l jal 
where o”’ is the inverse of the matrix o;; given in (4). 


m—1 


Now consider X’, with (2, — m,) replaced by > ye 


xX’ = (x; — m,)’ ghdee 


my, Mer 


2 
(rp-1 —e Mx) 


{(ay — my) + +++ + (ea — m)}” 


Me 


+ 
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Hence, if we write 


k—1 k—1 


xX’ = Zz >. ai; (x; — m,)(x; —m,), 


t=] jel 


the matrix a,; is 


(5) ai; = bs + . ’ (i  j). 
mM: M™ 
The remainder of the proof consists in showing that (5) is the inverse of 
(4). Pearson does this by a rather complicated polar transformation, but the 
student who has some familiarity with the evaluation of determinants will 
find it a fairly easy exercise, as Hotelling [2] has pointed out. It may be helpful 
to write (4) as 


(4’) ois = M; (1 ~ - = (i ¥ j), 


and to invert (5) rather than (4), or to prove that the product of the matrices 
ai; , oj is the unit matrix. 

Hence, by the first part of Pearson’s paper, we reach the result that in the 
limit as n becomes large, X* follows the x’ distribution with (k — 1) degrees of 
freedom. 

An approach which avoids most of the mathematical complexities in Pear- 
son’s argument has been pointed out by Fisher [3]. If the observations 2; are 


regarded as following independent Poisson distributions, their joint frequency 
function is 


re mii Ar mi! 
© iit oe 
i! 


i=1 imi DT, : 
since >-m; = n. 
Under this assumption, their total T = }0z; also follows a Poisson distribu- 
tion, with mean }-m; = n. The frequency function of T is therefore 


é i. 
(6) T! 


Hence, on dividing (6) by (6’) the conditional frequency function of the 2; , 
given that their total 7 has the value n, is 


n! m,\*! (m2\7? (=) 
Xi! te! -++ apt \n n n : 


This is the same as the basic multinomial (1). 

This argument implies that in an investigation of the distribution of X’ we 
may start by regarding the zx, as following independent Poisson distributions, 
subject to the restriction that dx: = Nn. 
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In the limit, as the m; become large, the quantities 


become normally distributed with means zero and unit standard deviations, 
since the Poisson distribution of z; has mean m; and standard deviation +/m; . 
Hence the limiting distribution of X’ is that of the quantity 


yityet--: + yi, 


where the y; gre independently distributed but are subject to the single linear 
restriction 


x k 
Lyi Vii = 2 (ai — mi) = 0. 
t= to 

The fact that in the limit X? follows the x’ distribution with (k — 1) degrees 
of freedom can now be established by integration or by quoting well known 
theorems on the analysis of variance. This approach also makes it clear that 
if further homogeneous linear restrictions are imposed on the variates (x; — mj), 
either by the structure of the data or in the process of fitting, the effect will 
merely be to reduce the degrees of freedom in x’. 

Pearson next considers the situation in which the m; depend on parameters 
that have to be estimated from the sample. Denoting by m; the expectations 
derived from sample estimates of these parameters, and by m; the true ex- 
pectations, he discusses the difference 

i a - Hm _ yt 


i=1 M; int 0% 


He suggests that this difference will usually be positive, because we ought to 
be able to do a better job of fitting when we can adjust the estimates of the 
parameters to suit the vagaries of the sample. He argues, however, that the 
difference will be small enough so that if we regard X” as also distributed as 
x’ with (k — 1) degrees of freedom, the error in this approximation will not 
affect practical decisions. 

In this conclusicn, which is reached with some sign of hesitation, he may 
well have been justified for many applications. We now know that the number 
of degrees of freedom must be reduced in order to give the correct limiting 
distribution. Perhaps the most common of all uses of the X° test is for the 
2 X 2 contingency table. Unfortundtely, Pearson’s suggestion works rather 
poorly in this case, since he attributed 3 degrees of freedom to X’, whereas it 
should receive only 1. This point caused some confusion and controversy in 
practical applications, and was not settled for over 20 years. 

Finally, the paper contains eight numerical applications of the new technique. 
In two of these he pokes fun at Sir George Airy and Professor Merriman. They 
had both published series of observations which they claimed to be good illus- 
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trations of variates that follow the normal distribution. In the absence of any 
test of goodness of fit, Airy and Merriman could judge this question only by 
eye inspection. Pearson showed that the significance probability for Airy’s 
data was 0.014, although the data from which Pearson calculated X* had already 
been smoothed by Airy. Merriman fared worse, his probability being 1} parts 
in a million. These examples show the weak position in which the scientist was 
placed when he had to judge goodness or badness of fit in the absence of an 
objective test of significance. 

To summarize, Pearson established the necessary distribution theory for 
finding significance levels when the null hypothesis provides the exact values 
of the m;, except that he did not show that the exact distribution of X°, which 
is discontinuous, actually approaches x° as a limiting distribution. A fully 
rigorous proof.may be given by the use of moment-generating functions [8]. 


4. The distribution of X¥* when the expectations are estimated from the sample. 
This problem is much more difficult and was not elucidated until the appearance 
of Fisher’s 1924 paper. In the intervening period, a paper by Greenwood and 
Yule [4] in 1915 illustrates the perplexity which existed among critical users of 
the test and which led to the “degrees of freedom” battle. The authors were 
attempting to examine the effects of inoculation against typhoid and cholera. 
They present a substantial number of 2 X 2 tables containing subjects classified 
as inoculated or not, and also as to whether they contracted the disease following 
exposure to it. The following is an example. 
Kalain (Cholera) 


Not 


Attacked Attacked Total 


1630 
1033 


2663 





X? = 6.08. 


Following Pearson’s rule, they assign 3 degrees of freedom to X°. This gives 
a P of 0.108, whereas with 1 degree of freedom, P is 0.015. They realised, how- 
ever, that the hypothesis that inoculation is without effect could be tested, 
alternatively, by calculating the difference (p, — pe) between the percent ill 
among the inoculated and the non-inoculated. On the null hypothesis, the ratio 


Pig P2q2 
ny + No 


is approximately a normal deviate with mean zero and unit standard deviation. 
This test, as they, found, gave more statistically significant results than Pear- 
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son’s test. The quantity R is exactly equal to X if we use the pooled percent 
ill, p, in estimating the two variances in the denominator, so that the “normal 
deviate” test and the X* test should be identical. It is not clear that Green- 
wood and Yule recognised this in 1915. 

Although giving the impression of being somewhat in a quandary as to which 
test to employ, they content themselves with the decision to adopt Pearson’s 
test, pointing out that it is the more conservative of the two, and adding that 
the issue deserves further theoretical investigation. 

After some controversy, the matter was cleared up in theoretical papers 
[3], [5] by Fisher in 1922 and 1924, supported by sampling experiments which 
were published by Yule [6] and Brownlee [7]. Fisher’s 1922 paper included a 
discussion of 2 X 2 contingency tables, and showed that for this case X° is 
the square of a single quantity which had a limiting normal distribution, and 
that the X* test and the test of (p; — p2) by the normal distribution are identical. 

Fisher’s 1924 paper is much more general. He points out that the limiting 
distribution of X* depends on the method of estimation. With a poor method 
of estimation, X* may frequently have a large value even if the theory is cor- 
rect. It is therefore necessary, in a general proof of the distribution of X’, to 
state what is to be the method of estimation. At first sight, the natural method 
would seem to be to choose the unknown parameters so that X° is as small as 
possible. Fisher shows that in the limit in large samples, this method becomes 
equivalent to the method of maximum likelihood. For his main proof, this 
result serves as an ingenious lemma, since at one point in the main proof he 
assumes that estimation is by maximum likelihood, while at another he as- 
sumes that it is by minimum X”. 

Although Fisher’s main proof is not fully rigorous, it is worthwhile to outline 
the principal steps, because the proof does reveal the core of the problem, and 
a rigorous proof requires advanced methods. Fisher starts in the same way as 
Pearson, by considering 


. k x. k x k 1 1 

2 ’ i i 2 

Hts Xe: FS ws *=pa(t-3), 
inl M; inl Mi i=l Mm; mi 


where m; is a specified function of a single unknown parameter a, with m; = 
m,(a), m; = m;(a’). He expands in a Taylor series about the point a’. The 
first two terms give 


2 r r 2 2 , 2 
x* oo : a - => “ (=) ba + 2 aif 2 (=) 1 om (5a) 
a 


m’, m’;* \ da’ m; da’? } 2! ’ 


where 6a = (a — a’). Since the method of estimation consists in choosing a’ 
so that X” is a minimum, we have 


xi (am 
Zz , , _ 0, 
mi Oa 
so that the first term on the right vanishes. 
In the second term on the right, Fisher replaces z; by m;. The error intro- 
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duced by this step may be shown to be of the same order as the third term in 
the Taylor series, which has already been ignored. Hence, 


x? — X” = z{ ; (=) - cm (8ar)" 


m; \da’ Oa’? } 2! 


But if the identity }>m’ = n is differentiated twice, we find 


x (=) = 0. 





Oa!” 
Hence, 
2 ae 4 , am’, . 2 
X* — X" = om) | a) 


If a’ is regarded as a maximum likelihood estimate of a, we may use the 
standard result that the error of estimate (a’ — a) has a limiting normal distribu- 
tion, with mean zero, and variance given by 


1 x (1 = x 1 Bs} 
ia (= ve mi, \ da’ } J* 
This gives the neat result 


, 2 
r r a — a) 
x? — x . —- 
Ta’ 








Our object is to find the limiting distribution of xX”. At this point the facts 
in our possession are: (i) X° is distributed as x’ with (k — 1) degrees of freedom 
(this follows from Pearson’s results, since X* is calculated from the correct 
m’s); and (ii) X’ — X” is distributed as x’ with 1 degree of freedom (from 
Fisher’s argument). These facts are not sufficient to determine the distribution 
of X”. However, Fisher points out that the limiting distributions of X” and 
(a’ — a)” must be independent, since X” was obtained by minimizing X° with 
respect to a’. Given this additional result, it is easily shown that X’” must be 
distributed as x’ with (k — 2) degrees of freedom. 

The argument leads to two further results. Any method of estimation that 
is efficient gives estimates which become, in the limit, identical with the maxi- 
mum likelihood estimate. Thus the x’ distribution, with the appropriate re- 
duction in degrees of freedom, is valid for any efficient method of estimation. 
The argument also provides the limiting mean value of X” when the estimation 
is inefficient. An interesting corollary is that the mean value of X” exceeds 
that of X* when the efficiency is less than 50 percent. 

Rigorous proofs of the general limiting distribution, when several parameters 
are being estimated, are scarce in the literature. For the student, one of the 
best is that given by Cramér [8]. The restrictions under which he proves his 
result are stated below. He assumes maximum likelihood estimation. 
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THEOREM. Suppose that the k probabilities pai, az,-**, a) are known 
functions of s < k parameters a; , a2, --- , a . For all points of a nondegenerate 


interval A in the s-dimensional space of the a; , the p; satisfy the following con- 
ditions: 


(a) 2 Pilar, +a) = a; 


(b) pila,-*:,a%)>C’>0 


2 
(ce) every p; has continuous derivatives 2? ana _° P ; 
j Oa; Ocx), 


(d) the matrix D = (2*) is of rank s. Then X° is distributed in the limit, asn — ~, 
i 


in a x’ distribution with (k — s — 1) degrees of freedom. 


5. The limiting power function of the test. The literature does not contain 
much discussion of the power function of the X? test. There has been little demand 
for this from applications, because the test is most commonly used when we do 
not have a clear-cut alternative in mind, and are not in a position to make com- 
putations of the power. 

Suppose that we test the null hypothesis that the expectations are m; when 
in fact they are m;. If the values of m;, m’; and the significance level are kept 
fixed, then as nm increases, it turns out, as would be expected, that the power of 
the test tends to 1. This has been shown by Neyman [9]. In order to examine 
the situation in which the power is not close to 1 in large samples, we must 
somehow make the task continually harder for the test as n becomes larger. 
This can be accomplished either by making the significance probability decrease 
steadily as n increases, thus reducing the chance of an error of type I, or by 
moving the alternative hypothesis steadily closer to the null hypothesis. The 
second method will be discussed here. Let 


m; — Mm; = cr/n; that is, Di — pi = e;/Vn, 


where the quantities c; remain fixed as n increases. 
The nature of the limiting power distribution of X’ is indicated by the follow- 
ing argument, for which I am indebted to J. W. Tukey. We may write 


(7) oj — mM me _ ae md y/ m+ mi — m; 
Vm; Vm 


Now 


‘sade Wtemete cia 
y/i+ _ 14 — 
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This tends to 1 as n becomes large, since c; and p; are presumed to remain fixed. 


If we adopt Fisher’s approach to the distribution theory (Section 3), the 
quantities 
zi — mi 


Vm; 


tend to become normally and independently distributed with means zero and 
unit standard deviations, as n becomes large. Consequently, so do the quantities 


y = (x; — mi) fm 
Vm’, m; 


2 w(t—m)’_ of m,—m\* _< 2 
X= ’ — i —_———- = i i) 
a me duet a i dy + a;) 


where the y; are subject to the linear restriction 


k k 
Dui Vm = LD (x; — mi) = 0. 


t=1 tanl 


Finally, by equation (7), 


Thus, in the limit, X’ is distributed as a sum of squares of variates (y; + a,) 
independently and normally distributed with unit variances, but where the 
means a; are not all zero. The variates are subject to one linear restriction when 
the m; are completely specified. 

This type of distribution is known as a noncentral x’. It depends on two 
parameters—the degrees of freedom, in this case (k — 1), and a parameter 
of non-centrality (aj + a; + --- + aj), which has the value 

te 
apn Ap 
Tables of the noncentral distribution have been provided by Fix [10] and ap- 
proximations studied by Patnaik [11]. 

When the m; have to be estimated from the data, the limiting noncentral 
x’ distribution still holds, with a reduced number of degrees of freedom. A 
rigorous proof is obtained from Wald’s derivation of the limiting distribution 


of the likelihood ratio test criterion [12], which becomes equivalent to X° in 
large samples. 


> (m', — m,)? " “cin 
: 


6. Conditional X° tests. As has been mentioned, additional homogeneous linear 
restrictions imposed on the deviations (x; — m,) have the effect of reducing the 
number of degrees of freedom attributed to x’ in the limiting distribution of 
X’. These restrictions may arise in the process of fitting, or by the nature of the 
data. They may also be deliberately imposed by the statistician in the device 
known as a conditional test. This device is illustrated by the 2 X 2 contingency 
table, in which it has created some stimulating discussion [13]. 
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The data are classified according to two different axes, A and B. 








B, B Totals 
A, ru Ti2 1 
Ay tu X22 re 
senda td oncd Cy Ce n 





Data of this kind occur in at least three distinct experimental situations. 

(¢) We select a random sample of n from some population and classify every 
observation into one of the four cells. The symbol z,;; denotes the observed 
number falling in class A,B; , while p;; denotes the corresponding probability 
of falling in this class, where the sum of the four p’s is unity. The null hypothesis 
that the two classifications are independent amounts to the relation 


(8) Pu/Pu = pu/ Pe - 


The joint probability of this group of observations is the usual multinomial 


n! z z =z z 
(9) <a a 11 7712 7721 ae : 
zn! X12! Xm! Xoo! Pry Pris Pay P: 


Only two of the p;; need to be estimated from the data, because of equation 
(8) and the fact that the p,;; add to 1. Thus X* has (4 — 2 — 1) or 1 degree of 
freedom. 

(77) We take a random sample of size r; from a population denoted by A: , 
and an independent random sample of size rz from another population denoted 
by A:. The null hypothesis states that the probability p of an observation 
falling in B, is the same in both populations A; and A:. Given the null hy- 
pothesis, the probability of the sample is the product of the two binomials 


r,! z z f Te! z z 
0 tia) _ ttt otaa\, 
(I ) ‘zt 12! P q Mo Lx! P q \ 


This is not the same as the multinomial (9). Given data of type (7), however, 
let us arbitrarily impose the restriction thet in repeated sampling we will consider 
only those tables which have the same marginal totals r; , 72 as our data. Then 
(9) must be replaced by the conditional distribution of the z;; , given 7; and re . 
This conditional distribution is easily seen to be the same as (10). For, starting 
with (9), the distribution of 7; (and hence rz) is the! binomial 





! 
(11) (Pu + pur)"(par + Pra)”. 


rT; 
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To obtain the conditional distribution, we divide (9) by (11). The quotient 
reduces to (10) if we note that from (8), 


Pu 7 P21 
Pu + Pi P21 + P2 








=p (say). 


(ia) A third case is obtained if both sets of marginal totals are regarded as 
fixed in repeated sampling. Fisher’s tea-tasting experiment [14] is an example. 
The A classification tells whether the milk or the tea was added first, and the 
B classification tells whether the lady guessed that the milk or the tea was 
added first. In Fisher’s original experiment, he recommended that the lady be 
informed how many cups were of each kind, and pointed out that she would 
presumably match her guesses to those two numbers. Thus in repeated trials it 
is natural to regard both sets of margins as fixed. 

The appropriate basic distribution of the 2;; is the conditional distribution 
which develops from (10) if we keep c; and cz fixed. This is found to be 


(12) 1,1! Te! Cy! Ce! 
ss mM! Xy! Lio! Loy! Xe! 


Case (i) has 2 unknown parameters and 1 linear restriction on the z;; ; case 
(it) has 1 unknown parameter and 2 restrictions, while case (77) has no un- 
known parameters and 3 restrictions. 

Is the same X° test to be used for all cases? In large samples there is no conflict, 
because X* has the same limiting distribution however the linear restrictions 
arise. This is not so in small samples, where the distribution of X° differs in 
the three cases. Fisher [15] recommends that the distribution of X° obtained in 
case (iii) be taken as the exact small-sample distribution for all three types of 
data. Questions have been raised about this recommendation. 

Originally, part of the objection came perhaps from a feeling that there is 
something improper in keeping the marginal totals fixed in cases (7) and (72), 
because if we actually drew repeated samples of the same size by the same 
methods, the margins would not all remain fixed. For a rational appraisal, 
however, the only relevant factors are the effects of the marginal restrictions 
on the significance probabilities (or type I errors) and on the power (or type 
II errors). As regards type I errors, Fisher’s recommendation has the great 
advantage that in case (ii?) the significance probabilities can be computed 
exactly, whereas in cases (7) and (77) the distribution of X’ involves nuisance 
parameters, so that “‘exact’’ probabilities are not available. 

The issue thus reduces to the question whether any loss of power occurs if 
the case (ii7) test is employed with the first two types of data. For case (77) 
data, Barnard [13] proposed a different test which in some circumstances ap- 
peared to give a small increase in power. More recently K. D. Tocher [16], has 
proved the remarkable result that a modification of Fisher’s test is the most 
powerful, in the sense of Neyman and Pearson, for one-tailed tests with any 
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of the three types of data. The modification is necessary to make the problem 
amenable to Neyman and Pearson’s techniques. 


The modification may be illustrated by the example which Tocher presents. 


TABLE 1 
Tocher’s illustration 
Original table More extreme cases 
26|7 16| 7 
82) 5 41] 5 





Given the data on the left, we wish to make a one-tailed test at the 5% level. 
The two possible sets of data which deviate more from the null hypothesis are 
shown on the right. In Fisher’s exact test, we add the probabilities of the three 
tables as computed by formula (12). This gives 


0.26515 + 0.04399 + 0.00126 = 0.31040. 


This value is regarded as the significance probability. 
In Tocher’s modification, we also compute the total probability of all more 
extreme cases, that is, 


0.04399 + 0.00126 = 0.04525. 


If these numbers, 0.31040 and 0.04525, are both below the stated significance 
level, 0.05, we reject the hypothesis. If they are both above 0.05, we accept. If 
one is above and one is below, as in the present example, we calculate the ratio 


0.05 — 0.04525 “ 
— 926515 0.01791. 
Now draw a random number between 0 and 1. If this number is less than 
0.01791, we reject; if greater, we accept. 

Although this procedure may appear somewhat startling at first sight, the 
idea is basically simple. Consider how we can obtain a one-tailed test at the 
0.05 level from the 2 X 2 table in this example. If the null hypothesis is re- 
jected only when the two most extreme cases on the right of Table 1 occur, the 
significance level is actually 0.04525. The third most extreme case, represented 
by the data on the left of Table 1, occurs with probability 0.26515. Conse- 
quently, by the computation above, we obtain a test at the 0.05 level if we also 
declare as significant a fraction 0.01791 of the cases in which the data on the 
left are encountered. Tocher selects this fraction by a table of random numbers. 
There seems no other logical basis for deciding which particular fraction to 
select. 
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Part II. Some Aspects OF THE PrRacTICAL USE OF THE TEST 


7. The minimum expectation. Since x? has been established as the limiting 
distribution of X? in large samples, it is customary to recommend, in applications 
of the test, that the smallest expected number in any class should be 10 or (with 
some writers) 5. If this requirement is not met in the original classification, com- 
bination of neighboring classes until the rule is satisfied is recommended. This 
topic has recently been subject to vigorous discussion among the psychologists 
[17], [18]. The numbers 10 and 5 appear to have been arbitrarily chosen. A few 
investigations throw some light on the appropriateness of the rule. The approach 
has been to examine the exact distribution of X*, when some or all expectations 
are small, either by mathematical methods or from sampling experiments. 

The investigations are scanty and narrow in scope, as is to be expected since 
work of this type is time-consuming. Thus the recommendations given below 
may require modification when new evidence becomes available. 

To digress for a moment, the problem of investigating the behavior of X? when 
expectations are small is an example of a whole class of problems that are relevant 
to applied statistics. In applications it is an everyday occurrence to use the re- 
sults of a body of theory in situations where we know, or strongly suspect, that 
some of the assumptions in the theory are invalid. Thus the literature contains 
investigations of the ¢-distribution when the parent population is nonnormal, 
and of the performance of linear regression estimates when the regression in the 
population is actually nonlinear. Fortunately for applications, the results of 
theory sometimes remain substantially true even when some assumptions fail to 
hold. This fact tends to make statistics a more confusing subject than pure mathe- 
matics, in which a result is usually either right or wrong. 

In any problem of this kind, it is important to define what is meant by saying 
the results remain “substantially true.” I stress this point because a reader who 
becomes interested in a specific problem and tries to summarize the available 
knowledge may encounter considerable difficulty. Definitions vary from writer 
to writer and are sometimes entirely subjective, so that the researches may be 
presented in a form which baffles any attempt to apply a uniform definition. 
This remark is not intended as a criticism of work on the X? problem, where the 
task of summarizing is comparatively easy. However, I believe that the useful- 
ness of this kind of research would be enhanced by careful attention to the ques- 
tions: (i) how are we going to measure the disturbance caused by a failure in 
assumptions, and (ii) when are we going to call this disturbance “‘serious.”’ 

In the present instance, my criterion is to compare the exact P and the P from 
the x? table, when the null hypothesis is true, in tae region in which the tabular P 
lies between 0.05 and 0.01. This criterion is not ideal, but it does appraise the 
performance of the tabular approximation in the borderline region between 
statistical significance and nonsignificance. A disturbance is regarded as unim- 
portant if when the P is 0.05 in the x? table, the exact P lies between 0.04 and 
0.06, and if when the tabular P is 0.01, the exact P lies between 0.007 and 
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0.015. These limits are, of course, arbitrary; some would be content with less 
conservative limits. 

The results suggest that four cases need to be considered separately. 

(i) Goodness of fit tests of bell-shaped curves such as the normal distribution. The 
distinguishing feature of this case is that usualiy only one or two expectations at 
the tails are small, the others being above the conventional limits of 5 or 10. 
Cochran [19] has shown that there is little disturbance to the 5% level when a 
single expectation is as low as }. 

This is also true for the 1% level if the number of degrees of freedom in X? 
exceeds 6. Two expectations as low as 1 may be allowed with negligible disturb- 
ance to the 5% level. Since the discrepancy between an observed and a postulated 
distribution is often most apparent at the tails, the sensitivity of the X? test is 
likely to be decreased by an overdose of pooling at the tails. Thus considerations 
of the power of the test urge us to use cells with as small expectations as we dare 
from distributional considerations. The inflexible use of minimum expectations 
of 5 or 10 may be harmful. 

(ii) 2X 2 contingency tables. This case is the most thoroughly worked out 
and can be regarded as solved for practical purposes. Fisher [15] has given the 
method of obtaining an exact solution, which is not too laborious in samples up 
to size 30. Tables such as Mainland’s [20] give the probability levels of the exact 
distribution for two samples each of size up to n = 40, and Yates’ table [21] 
gives almost exact tests based on X? after correction for continuity. 

(iii) Tests in which all expectations may be small. This case occurs from time 
to time, for example, in genetical studies in which a Mendelian ratio is being 
compared over a number of small families. Results by Neyman and Pearson [22], 
Cochran [23] and Sukhatme [24] suggest tentatively that the tabular x’ is toler- 
ably accurate provided that all expectations are at least 2. 

With very scanty data, there is one danger—that only a few different values 
of X? are possible, so that the effects of discontinuity become noticeable. For ex- 
ample, consider the 2 X 4 contingency table with marginal totals shown below. 
All expectations are exactly 2. 


hall 
| s 
ce 4 4 ae 
If we construct all tables which satisfy these marginal totals, only seven different 
values of X* are found. The exact distribution of X*? and the x’ approximation 
(with 3 degrees of freedom) are shown in Table 2. The agreement is not good, 
the tabular P’s being fairly consistently too low. 

With such a small number of values of X’, a cortection for continuity comes 
to mind. To apply this for X? = 2, we read the x’ table at x* = 1, this being 
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half way between 2 and 0 (the next largest value of X*). The corrected P’s 
show a considerable improvement in fit. 

In practice, a small table of this kind can be handled by computing the exact 
distribution of X* in cases of doubt about the adequacy of the x’ approxima- 
tion. For more complex, contingency tables, a systematic method of computa- 
tion has been given by Freeman and Halton [25]. 











TABLE 2 

Exact distribution of X? for a 2 X 4 contingency table. P{X? = X}} 
x3 Exact x? Table Corrected 
0 1.000 1.000 1.000 
2 .899 542 .801 
4 .362 ' 261 .391 
6 . 243 okie 172 
8 .064 .046 .072 
10 .030 .019 .029 


16 -0005 -0011 .004 


(iv) Tests in which all expectations are small and X* has many degrees of free- 
dom (say >60). Examples occur in genetical research. The data are presented 
in, say, a 2 X 200 contingency table, with all 400 expectations small. 

In this case, the exact distributions of X° and x’ are both approximately 
normal, since the degrees of freedom are large. However, the two distributions 
have different variances, and the normal approximation to the exact distribution 
is sometimes quite different from the normal approximation to x’. 

This problem has been studied by Haldane [26], [27] who has worked out the 
exact mean and variance of X° for several types of data. His results are given 
below for the two cases that are perhaps most common. 

(a) We have g groups, each containing s individuals, classified into one of 
two classes. The null hypothesis specifies a known constant probability p that 
any individual falls into the first class. If x; individuals fall into this class in 
the ith group, and if we wish to test against the alternative that p varies from 
class to class, a familiar extension of the X’ test is to calculate 


x* = > (xs = sp)” 
; ‘<1 Spq 
with g degrees of freedom. Haldane shows that 


E(X’) = g, 


a 1 — 6pq 
X*) = 2e{ 1 + —_—_—== }. 
V(X’) a( + ae) 
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(b) Same data, but X* computed as for a 2 X g contingency table, since p is 
unknown. 








Then 


E(X?) = (g os De 
n—1 


V(x?) = 29 = 1)n' (n ~ 9) (1 _a- v). 
(n — 1)? (n — 2)(n — 3) 4 Ne 

To take an extreme case, suppose s = 2,g = 160,n = 320, m = 64, ne = 256- 
The mean and variance of X* are 159.5 and 159.4 respectively, whereas x’ has 
mean 159 and variance 318, twice as large. The normal approximation to X’ is 
satisfactory, but x’ gives very poor agreement [23]. In practice, such data may 
be dealt with by use of the normal approximation to the exact distribution, 
using Haldane’s expressions for the mean and variance. 

The question remains: where does case (iii) shade into case (iv)? The available 
data suggest that case (iii) may apply when X’ has less than 15 degrees of free- 
don, while case (iv) may hold if X* has more than 60 degrees of freedom. The 
intervening gap needs investigation. 


8. The correction for continuity. The exact distribution of X? is always dis- 
continuous. When all expectations are small, the number of distinct values of 
X’ may be very limited. In such cases the x’ table may give a poor appréxima- 
tion to the exact P{X* = X¢}, mainly because the area of a continuous curve is 
used to approximate the sum of a small number of discrete probabilities. The 
correction for continuity, introduced by Yates [28], is an attempt to remove 
this source of error. It amounts to reading the x’ table, not at the point Xé , 
but at a point halfway between X} and the value of X’ immediately below X¢ 
in the discrete series of values. 

In practice, the correction is seldom needed except when X* has 1 degree of 
freedom, as when testing a single binomial ratio or a 2 X 2 contingency table. 
In the 2 X 2 table there are various ways of computing the correction, de- 
pending on how one likes to compute X*. My own preference is to find the 
difference d between zx; and m;, which is the same, apart from sign, in all four 
cells. The absolute value of d is reduced by }, and X’ is computed as 


Xt=(\d|- PD. 
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Note that in the 2 X 2 table it is X that is corrected for continuity, not X’, 
since the successive values of d differ by unity. 

When X” has 1 degree of freedom, a good rule is to apply the correction 
whenever it produces any appreciable difference in the significance probability. 
The correction has a tendency to over-correct, changing the tabular P from 
too small to too large, but is usually an improvement. 

If a number of X’ values, each with 1 degree of freedom, are added to form 
a total X°, the individual X* values should not be corrected for continuity, 
because the over-correction mounts up in a disconcerting manner [19]. After 
it has been obtained, the total X’ is corrected, if this is necessary, by the method 
given in the following paragraph. 

Compute the next largest value of X° which the structure of the data permits. 
Read the x’ table at a point halfway between this value and the observed X”. 
This procedure was illustrated for a 2 X 4 table in the preceding section. Some- 
times the next largest value of X° is not immediately obvious and trial and error 
is required to find it. 


9. The construction of classes. When X®? is used to test the hypothesis 
that the observations follow a continuous frequency distribution, the first step 
is to group the observations into classes. Both the number of classes and the 
division points between classes are at the disposal of the investigator, and the 
choices that he makes will affect the sensitivity of the test. I believe that the 
common practice is to have a moderate number of classes, say between 10 and 
25, and to make the class intervals equal. Although information about the best 
rule for constructing the classes is still meager, the recommendations of those 
who have looked into this problem are contrary to current practice. 

With regard to class intervals, Mann and Wald [29] and Gumbel [30] suggest 
that these be chosen so that the expected number is the same (= n/k) in all 
classes. These authors do not claim that this will increase the power of the 
test, but merely suggest that it is likely to be a good procedure. Gumbel points 
out that if this method is used in conjunction with a rule for choosing the value 
of k, much of the arbitrariness that accompanies the construction of class 
intervals is removed. Under this method, the computational steps are first to 
estimate the constants (mean, s.d., etc.) which determine the fitted curve, then 
find the class boundaries which give equal expectations in each class, and finally 
count the observed numbers x; which fall in the respective classes. The value of 
X’ is given as 


72 k 2 
X= > zi-n. 
n 


The paper by Mann and Wald deals with the choice of the number of classes, 
k. The null hypothesis is assumed to specify the distribution completely, and n 
is assumed large enough so that the limiting x’ distribution is applicable. 

Some criterion is required to define what is meant by a “best” value of k. 
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It seems natural to try to maximize some property of the power function of the 
test. The criterion set up by Mann and Wald is a little complex to describe, 
but this stems from the complexity of the problem. 

They define the distance A between the null distribution and any alternative 
distribution as the maximum difference between the heights of the two cumu- 
lative distribution functions. It becomes evident, after some examination of the 
problem, that there is no hope of choosing k so as to maximize the power function 
of X’ at all points along its course. They decide to concentrate on maximizing 
the power at about the point where the power is 3. This is an arbitrary but 
reasonable choice. The two principal properties possessed by their “best” k 
are as follows. 

(i) For a value of A which they determine, the power of the X° test is at 
least 4 for all alternative distributions whose distance from the null distribution 
is at least A. This value A is a simple function of sample size and, as would be 
expected, it decreases steadily with increasing sample size. 

(ii) If any & other than the “best” is chosen, the power of X° is less than } 
for at least one alternative whose distance from the null distribution exceeds A. 

The best k is given by the formula 


k=4 je = ry. 


where 


1 eo 
7a | eo" ay = a, 


where a is the significance level. Thus c = 1.64 for a test at the 5% level. 

The optimum values of k are substantially higher than those customary in 
practice. For a test at the 5% level, k rises slowly from 31 at n = 200 to 78 at 
n = 2,000. 





TABLE 3 
Optimum number of classes (Mann and Wald) 
n 200 400 600 800 1,000 1,500 2,000 


k 31 41 48 54 59 70 78 


A good exposition and critique of the Mann-Wald paper has been given by 
Williams [31]. The Mann-Wald method is more tedious to compute than the 
usual procedure, partly because of the increased number of classes and partly 
because of the fitting with equal expected numbers. Williams shows, however, 
that the optimum is a broad one, and that the value of k in Table 3 can probably 
be halved with little loss in sensitivity. 

The Mann-Wald paper, although an able performance in a difficult field, is 
far from a complete investigation of the optimum ‘number of classes. Such an 
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investigation is unlikely to be forthcoming soon. What is the user of the X’ 
test to conclude from their results? My own reaction has been to put more 
computational work into X’ tests of continuous distributions, by increasing the 
number of intervals and using unequal lengths of interval where this is neces- 
sary in order to avoid classes with high expected numbers. For sample sizes 
between 200 and 1000, their recommended expected numbers per class in 
Table 3 range from 6 to 16. With Williams’ modification, the range is from 12 
to 32. This does suggest that there is an appreciable loss of power if classes with 
expectations of more than 50 are commonly used. 


10. Summary recommendations. The following is an attempt to set down in 
brief form the recommendations about the computation of X? which flow from 
the discussion in this part and from practical experience. The recommendations 
are not as explicit as I should like. They can, I believe, be made more explicit, but 
this requires detailed study that goes beyond the scope of the present paper. The 
total number of observations is n. 

I. Attribute data. The data come to us in grouped form. Pooling of classes is 
considered undesirable because of loss of power. 

(a) The 2 X 2 table. Use Fisher’s exact test (i) if n < 20, (ii) if 20 < n < 40 
and the smallest expectation is less than 5. Mainland’s tables [20] are helpful 
in all such cases. If n > 40, use X’*, corrected for continuity if the smallest 
expectation is less than 500. 

(b) Tables with degrees of freedom between 2 and 60 and all expectations less 
than 5. If n is so smal! that Fisher’s exact test can be computed without ex- 
cessive labor, use this. Otherwise use X*, considering whether this needs cor- 
rection for continuity by finding the next largest value of X’. 

(ec) Tables with degrees of freedom greater than 60 and all expectations less 
than 5. Try to obtain the exact mean and variance of X’ and use the normal 
approximation to the exact distribution. 

(d) Tables with more than 1 degree of freedom and some expectations greater 
than 5. Use X® without correction for continuity. 

IT. Continuous data. The data must first be grouped. Use enough cells to 
keep the expectations down to the levels recommended by Williams (12 per 
cell for n = 200, 20 per cell for nm = 400, 30 per cell for n = 1,000). At the tails, 
pool (if necessary) so that the minimum expectation is 1. 


Part III. Utiziry or tHe TEst 


11. Criticisms and limitations of the test. A competent appraisal of the utility 
of the X? test would require a sampling survey of scientists and others who try 
to draw conclusions from data. In such a survey the object would be to discover 
how frequently these workers have occasion to use a X? test, and to what extent 
the application of the test really seems to help them. In fact, such a survey, di- 
rected at the use of statistical techniques in general and not merely at the X? 
test, might be very illuminating to statisticians if it could be carried out despite 
the obvious difficulties. Statisticians are, I think, rather quick to jump to con- 
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clusions about the kinds of problems which scientists in other fields are supposed 
to face, and about their presumed uses and misuses of statistical methods and 
ideas. 

In the absence of survey data of this kind, the statistician can give only a 
personal opinion, based on such contacts as he has had with the users of the X? 
test. I will content myself with the cautious statement that since the construction 
of hypotheses and their continued modification or rejection in the light of new 
data is one of the standard tools of science, some kind of test of the agreement 
between theory and data must often be useful. The experiences of Airy and 
Merriman illustrate the uncomfortable position in which the scientist is placed 
when he has to state, without the benefit of such a test, whether his observations 
are in accordance with the predictions of some theory. 

On the other hand, a reading of the literature reveals the opinion, expressed 
by several writers, that the X? test is of restricted usefulness. The reasons for this 
critical verdict seem to be diverse. Some of the criticism is directed at the X* test 
itself, but some seems to apply to composite, or “general purpose” tests of sig- 
nificance as a whole, and some to all tests of significance. 

Considering first the criticisms of X? itself, the name “goodness of fit” is mis- 
leading, because the power of the test to detect an underlying disagreement. be- 
tween theory and data is controlled largely by the size of the sample. With a 
small sample, an alternative hypothesis which departs violently from the null 
hypothesis may still have a small probability of yielding a significant value of X. 
In a very large sample, small and unimportant departures from the null hypoth- 
esis are almost certain to be detected. Consequently, when X? is nonsignificant, 
the amount by which the null hypothesis has been strengthened depends mainly 
on the size of sample. This is one of the principal reasons for such misuse of the 
test as exists. Authors sometimes write as if the validity of their null hypothesis 
has been greatly strengthened, if not definitely established, by a goodness of fit 
test made on very scanty data. 

Secondly, as Gumbel has pointed out, the X? test for a continuous frequency 
distribution is not unique, because of the freedom of choice of number of intervals 
and end-points of the intervals. Although this is an argument for more standardi- 
zation in the application of the test, the objection perhaps is minor rather than 
major. At least, statisticians have not seen any overwhelming advantage in hav- 
ing just one test of a given null hypothesis against a given alternative. In recent 
years there has been active research in the development of quick, though ineffi- 
cient, tests for problems in which satisfactory, but less speedy, tests already 
exist. The tests will give different values of P from the same data, but no serious 
objections to this situation seem to have been noticed. 

There are two available substitute tests which resemble the X? test in that 
they are not directed against any specific alternative. One is the w* test (Section 
13). This was constructed in order to avoid the grouping of continuous data that 
is necessary with X*. The other, for data that are in grouped form, is the likeli- 
hood ratio test against a completely general alternative hypothesis (Section 14). 

One limitation of X*, or of any nonspecific test, is that when the alternative 
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hypotheses can be fairly clearly defined, we may hope to obtain another test, 
directed against these alternatives, that will be more powerful than X?. An 
example is Neyman’s “smooth” tests (Section 15). These were constructed to 
detect alternative hypotheses that depart from the null hypothesis in some 
continuous or smooth fashion. Like X*, the smooth tests are still general, since 
they do not demand detailed knowledge of the nature of the alternatives. Further 
down the scale there is a variety of supplementary tests to X°. 

Finally, the X? test is sometimes used when what is needed is not a test of sig- 
nificance of the usual type. There are numerous occasions when the null hypo- 
thesis is not expected to be exactly- true, but at best approximately true. The 
argument against X? in this situation has been developed amusingly by Berkson 
(32]. He writes ‘‘I make the following dogmatic statement, referring for illustra- 
tion to the normal curve: ‘If the normal curve is fitted to a body of data repre- 
senting any real observations whatever of quantities in the physical world, then 
if the number of observations is extremely large—for instance, on the order of 
200,000—the chi-square P will be small beyond any usual limit of significance.’ ”’ 

If this statement is granted—and counter-evidence, to put it mildly, is not 
abundant—then Berkson proceeds to the Socratic conclusion. What is the point 
of applying a X? test to a moderate or small sample if we already know that a 
large sample would show P highly significant? 

In his original paper, Karl Pearson was aware of this issue, and did not seem 
to feel uncomfortable about it. He writes, ‘“Nor again does it appear to follow 
that if the number be largely increased the same curve will still be a good fit. 
Roughly the x’s of two samples appear to vary for the same grouping as their 
total contents. Hence if a curve be a good fit for a large sample, it will be good 
for a small one, but the converse is not true, and a larger sample may show that 
our theoretical frequency gives only an approximate law for samples of a certain 
size. In practice we must attempt to obtain a good fitting frequency for such 
groupings as are customary or utile. To ascertain the ultimate law of distribution 
of a population for any groupings, however small, seems a counsel of perfection.” 
Although it is hazardous to try to read another man’s mind, his attitude was ap- 
parently the defensible one that any theory is at best approximately true, but 
nevertheless, if we are going to reject a theory, we do so because it does not fit 
the data that we have, not because it would not fit a much larger sample of data 
that we do not have. 

Nevertheless, I would agree with Berkson that in this situation an ordinary 
test of significance is not very useful. It is more difficult to say just what we do 
want. One attack would be to reformulate the null hypothesis so that, instead 
of testing whether a binomial p equals po , we try to construct a test of the null 
hypothesis that p lies in the specified range po , 71. 

As an alternative approach, fiducial or confidence limits seem to be helpful. 
Suppose that these limits are set up for the difference between two percentages 
in a 2 X 2 contingency table, the ordinary null hypothesis being that the true 
difference is zero. If the two limits are far from zero, then even when X? is non- 
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significant we are warned that the data do not establish the null hypothesis as 
approximately true. If the limits are both near zero, on the other hand, we may 
be able to conclude that the null hypothesis, although presumably not exactly 
true, is close enough to the correct hypothesis for all practical purposes. 

In testing goodness of fit of a frequency distribution, the extension of this ap- 
proach is Kolmogorov’s method [33] for constructing confidence bounds for the 
cumulative frequency distribution, given a sample. 

To summarize, the X? test is helpful primarily in the exploratory stages of an 
investigation, when there is no very clear knowledge of the alternative hy- 
potheses. It is well to remember that the size of sample determines whether 
the test really is a severe test of the null hypothesis. 


12. Interpretation of high P’s. The question of the interpretation to be placed 
on very high P’s, say those greater than 0.99, has been raised from time to time. 
In the few instances of this kind that have come my way, my practice has been 
to give the data further scrutiny before regarding the result as evidence in favor 
of the null hypothesis. 

Events have justified this practice. In nearly every instance, something wrong 
was discovered, most frequently a numerical mistake or an error in the formula 
used to compute X?. In one set of data assembled by geneticists, a whole group 
of X? showed P’s of the order of 0.999. The reason was that these X* values had 
been obtained by adding a large number of X* values, each with 1 degree of 
freedom, and all the original (1 d.f.) X? had been corrected for continuity. The 
over-correction which is a feature of this device had piled up to such an extent 


that their total X?’s were much smaller than those following the x? distribution. 
In another case, after discussion with the assistants of the scientist in charge, I 
surmised that the observations had been influenced by the anticipations of the 
scientist. Fisher [34] has raised a similar speculation with respect to some of 
Mendel’s results, without any suggestion of improper scientific conduct on the 
part of Mendel. 


Part IV. Tests Wuicn ARE CoMPETITIVE TO X? 


13. The w’ test. Alternatives that have been proposed to the X? test are of 
two kinds. Several of the tests, like X?, are “general” tests. Then there is a bat- 
tery of supplementary tests that are intended for situations where the alternative 
hypothesis is more definitely known. 

The general substitute tests that have been proposed have not given X? very 
serious competition. This is understandable because of the long history of X? and 
of its inclusion as standard doctrine in most elementary courses, and because 
some of the substitute tests are limited in the type of hypothesis with which they 
can cope. Moreover, despite the weaknesses of the X? test discussed in Part III, 
the advantages of the alternative tests have not yet been clearly enough demon- 
strated to win many converts. Consequently, Part IV contains only a brief and 
rather noncommital introduction to these tests. 
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The first general test, developed by Cramér [35], von Mises [36] and Smirnov 
[37], was constructed mainly for use with small samples. The null hypothesis 
completely specifies the frequency distribution followed by the observations. 
Unlike X?, the w? test requires no grouping of the observations, an obvious ad- 
vantage with small samples. The test is based on a comparison of the cumulative 
frequency function F(x) specified by the null hypothesis with an estimate of the 
cumulative frequency made from the sample. This estimate, F*(x), is simply r/n, 
where r is the number of observations in the sample which are Sz. The test 
criterion proposed is the Stieltjes integral 


S 


fw / ” (F(a) — F*(2)\? dF (2). 


If F(x) is continuous, this may be shown to satisfy 


Pais +> [Pe be eat 
12n? © neat ji 2n ; 
where the values x; , 22, ---, 2, are now arranged in increasing order. 

The mean and variance of w are known, and also its limiting distribution 
(which is nonnormal) as n — ». A table of this distribution by Darling and 
Anderson [38] has appeared recently. Practical use of this test is restricted by 
the condition that F(z) must be known and by lack of information about the 
small-sample distribution of w’. 


14. The likelihood ratio test. If the data are presented in grouped form, and 
if the alternative hypothesis is completely general, it is known that in large 
samples the X? test and the likelihood ratio test become equivalent [9]. We start 
from the usual multinomial 


ni zh 


Pr = - pi! po? +++ pi’. 
Zl--- al! f 


The likelihood on the null hypothesis is found from p; = m;/n, where m; are 
the expectations estimated by maximum likelihood (unless they are explicitly 
given). The likelihood on the unrestricted alternative is found from p; = x;,/n. 
Hence the likelihood ratio becomes 


(2 a. re y" Te y 
my, mo Mk E 
Its logarithm is 


k . . 
L= > a: log () = > x log {1 a5 mi 
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When this is expanded in a power series in the (x; — m,), the leading term is 
X’ for the maximum likelihood estimates of the parameters. 

In view of the equivalence of the two criteria in large samples, there seems 
no advantage, except one of taste or convenience, in one test over the other. 
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For small samples, the suggestion has been made from time to time that the 
likelihood ratio is to be preferred. Examples worked by both tests have been 
presented and discussed by Neyman and Pearson [22] and Fisher [39]. Since 
users of statistical methods naturally do not wish to learn more tests than are 
necessary, 2 movement to replace X”* by the likelihood ratio seems unlikely to 
gather momentum unless some definite advantages can be shown to follow. 
The advantage in computing time is at most small, but there may be an increase 
in power. The striking way in which many different configurations of the data 
turn out to give exactly the same value of X’ in small samples suggests an element 
of coarseness in the X° test. This coalescence happens to a much reduced extent 
with the likelihood ratio. However, not enough data about relative power has 
accumulated to permit a verdict on this issue. 


15. Neyman’s smooth tests. As in the w* test, Neyman [40] postulates that 
the cumulative frequency F(x) (assumed continuous) is known exactly from the 
null hypothesis. The first step is to replace the observations z; by the familiar 
“probability integral” transforms y; , where 


¥i= F(zx,). 


If the null hypothesis is correct, the variates y; follow a rectangular distribution 
in the interval (0, 1). The problem, therefore, reduces to that of finding a test 
for this transformed hypothesis. 

Neyman points out that the conceivable alternatives to the null hypothesis 


fall into two broad classes. The first class, of “smooth” alternatives, contains 
frequency functions which are continuous and which depart in some gradual 
and regular manner from the null hypothesis. The second class contains all 
other alternatives, whose deviation from the null hypothesis is in some respects 
erratic or discontinuous. The X° test is not directed specifically at either class, 
and is to some extent effective against both types of departure from the null 
hypothesis. Neyman’s object is to develop tests sensitive to the first class of 
alternatives. 

If a “smooth” alternative holds, the transforms y; will no longer follow a 
rectangular distribution, but will presumably follow a continuous distribution 
with a limited number of maxima and minima. The proposal is, therefore, to 
test the y; for polynomial trends, on the assumption that a polynomial of fairly 
small degree will satisfactorily represent the smooth alternative. The computa- 
tions involved and a discussion of the appropriate degree of the polynomial are 
presented in [40]. 


Part V. Tests Wuich ARE SUPPLEMENTARY TO X? 


16. A supplementary test based on runs. X? takes no account of the succession 
of + and — signs in the deviations (x; — m,) between observations and expecta- 
tions. When a smooth alternative holds, it seems likely that the succession of 
signs will exhibit some systematic features, such as a long run of +'s followed 
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by a run of —’s, and this has often been observed in applications of X*. David 
[41] has adapted the now familiar “run” test as a supplementary test to X”. 
In the run test, we count the number of runs and refer to a table which shows 
the significance levels of this quantity, given the total numbers of +’s and 
—’s in the series. David has shown that the limiting distribution of the number 
of runs is independent of that of X’. 

The run tests will, of course, be most effective for alternatives which produce 
few runs, such as a shift in the mean of the distribution. In the reference cited, 
the test is restricted to the case where the null hypothesis completely specifies 
the distribution; David states that a test has been developed for the case in 
which some parameters must be estimated. 


17. Tests based on low moments. When the null hypothesis postulates that 
the observations follow a normal, binomial or Poisson distribution, an alterna- 
tive to X? that is in fairly common use is to compare the lower moments of the 
theoretical distribution with estimated moments from the sample. With the 
normal distribution, the actual values of the mean and variance are rarely given 
by the null hypothesis, so that a comparison of these moments is not usually 
possible. Tests of skewness, derived from the third moment, and of kurtosis, 
derived from the fourth moment, can be made [15]. 

In the binomial distribution, if p is specified we can compare the sample mean 
and variance with the theoretical mean and variance. If p is not specified, we 
can compare variances. Suppose that we have g series of trials, and that each 
series contains s trials. The number of successes (out of s) in the 7th trial is x; . 
For a test of the mean proportion of successes, we regard 


we 
Pq 
gs 
as a normal deviate. 

18. Dispersion tests. Turning to the variance of x; , if p is specified the esti- 
mated variance is )>. (x; — sp)’/g, while the theoretical variance is spg. An 
appropriate test criterion for the variance is, therefore, 

a (x; + sp)” 
9S8Pq 
If p must be estimated from the data, either because it is unspecified or 


because the sample estimate disagrees with the postulated p, the test criterion 
becomes 


) (x; — z)° = so (2; — #)’ 


(?)( i gis — #) ° 
gs Ss cone 
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As is well known, the related quantities 


(13) > (x; — sp)? ‘set 8 2 (2x; * z)° 
spq t(s — £) 
are distributed approximately as x° with g and (g — 1) degrees of freedom, 
respectively, when the null hypothesis is true. 
The variance test can also be made when the number of trials s; varies from 
series to series. The test criterion becomes 


Eat) efed- $2) 


’ (1 “ ) 2(8 — 2) 


This test criterion can be shown to be identical with X’ as calculated for the 
2 X g contingency table. 


a 
&— 2 
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It is important to distinguish clearly between this variance X* test, which is 
sometimes called a dispersion test, and the ordinary goodness of fit X’ test. 
Suppose that we have 209 families each of size 4, and that every individual 
belongs to one of two classes A and a. The null hypothesis states that the 
probability p of an A is constant for all families. We may tally the numbers of 
families that have 0, 1, 2, 3, 4 A’s, respectively, and test this frequency distri- 
bution against the binomial (q¢ + p)*. This is the ordinary goodness of fit test, 
which has 3 degrees of freedom if p is unknown. The dispersion test, computed 
by formula (13), compares the observed variance of this frequency distribution 
with the theoretical binomial variance. 

The dispersion tests frequently prove more sensitive than X° when the bi- 
nomial null hypothesis fails because the probability of an A varies from one 
family to another. The notion of a measure of dispersion of this kind is due to 
Lexis and antedates the goodness of fit test. 


19. Subdivision of X* into components. In the analysis of variance, the sub- 
division of a sum of squares into single components, or ‘single degrees of free- 
dom,” is a familiar device. If variates y; are normally and independently dis- 
tributed with mean 0 and variance o” on some null hypothesis, these components 
are obtained by any linear transformation of the form 


k 
a = 2 Lis Yi 


tut 
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where 


0 ixh 

(14) Seent cy 

i (1, $= h. 

All z; are normally and independently distributed with mean 0 and variance 

o’. This transformation enables us to select those z; that are likely to be sensitive 

to a particular alternative hypothesis. Often only one or two of the z; are ex- 

amined, because it is hard to imagine any feasible alternative that would make 

the other z’s large. Thus the device replaces a ‘“‘sum of squares” test by a few 
more specialized tests. 

The corresponding subdivision of X° is easily obtained from Fisher’s device 
of regarding the observed numbers z; in the cells as following independent 
Poisson distributions, subject to a single linear restriction. Thus when all ex- 
pectations are large, we may take 


r,— mM, 
i 
Vm, 


as the set of unit normal deviates. Since these are subject to the linear restriction 


k k ° 
¥  — m) = Evin; w = 0, 
we must take 
A= z Vm; y;/n. 
Let the remaining Z; (¢ = 2, 3, --- k) be 
Zo = Dilgxy = Dlg Vm; ys + DL lm. 
3 

If these are to have means zero, we must have 


(15) > li; m; = 0. 
3 


Note that this relation makes all the remaining Z; orthogonal with Z, . Since 
, on . 
li; = lij Vm; , equations (14) become 


, 0 t +h, 
(16) ze Ui; l,j mj = | 
3 


\1 7=h. 
Any set of Z; whose coefficients satisfy equations (15) and (16) provide a 
breakdown of X? into (k — 1) single components. Then as an algebraic identity, 
k )? k-1 
fa (x; — npy 7. 
il Np; i=l 


As n increases, the individual terms on the right become in the limit 
independently distributed as x’ with 1 degree of freedom. In genetic analysis, 
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where simple interpretations can be attached to the Z;, this tool has proved 
useful [15]. 

The application of this breakdown to contingency tables, which requires 
care, has been elucidated by Lancaster [42] and Irwin [43]. In an r X c con- 
tingency table, X* can be partitioned into (r — 1)(c — 1) single components. 
Each of these represents the usual X* for a 2 X 2 table which is formed by 


amalgamation of cells in the original table. This breakdown is illustrated below 
fora3 X 3 table. 


Original table 


7 
T13 


X23 
X33 


C3 





Components 


| T12 
\| 


_ 
| 


T32 ; 
| 


— 


T22 





T3 


} 
C2 N32 | N32 n 


If the X° are calculated in the usual way for each 2 X 2 table, the partition 
is only approximate, in that in finite samples the individual X* do not add up 
to the total X° for the 3 X 3 table. The authors show how to obtain a partition 
which adds up exactly, that is, which satisfies the sets of equations (15) and 
(16). It appears that the approximate partition is adequate for most tests of 
significance; in fact, it has not been shown that the additive partition is really 
preferable to the approximate partition in small samples. 

Another application of the breakdown of X’ is to contingency tables in which 
numerical scores can be attached to one or both of the classifications. Yates 
[44] shows how to isolate and compare the regressions of the observations on 
these scores. 

In conclusion, the testing of individual components of X’ is analogous to the 


use of a set of independent ¢-tests instead of, or in addition to, an F-test in the 
analysis of variance. 


I wish to thank T. W. Anderson, E. L. Lehmann and J. W. Tukey for many 
helpful suggestions. 
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SOME RANK ORDER TESTS WHICH ARE MOST POWERFUL 
AGAINST SPECIFIC PARAMETRIC ALTERNATIVES! 


By Mitron E. Terry 
Unwersity of North Carolina and Virginia Polytechnic Institute 


Summary. The most powerful rank order tests against specific parametric 
alternatives are derived. 

Following the methods of Hoeffding [4], we derive the most powerful rank 
order test of whether N observations come from the same but unknown popula- 
tion against the alternative that the observations Z,,---, Zy comefrom popu- 
lations which have the joint density 


N 1 1 
I Re | - 5% — dt — “|, 


where d, , --- , dy are given constants, not all equal, and £/c is sufficiently small. 
The test criterion was found to be c,(R) = > dEZw +, , where EZy; is the ex- 


pected value of the 7th standard normal order statistic and R = (r,,---, rw) 
is the permutation of the ranks. The distribution of this statistic was shown to 
be asymptotically normal providing the known constants d; , --- , dy satisfied 


Noether’s condition [9]. 

The two-sample distribution is a special case, and the resultant statistic 
¢,(R) is shown to be asymptotically normal. The approximation of the dis- 
tribution of the c,(R) statistic to the distribution C(1 — 2’), -1 < x < 1, 
is investigated. This statistic is then compared to the existing Mann and Whit- 
ney U statistic. No method having been found for analytical evaluation of the 
power of this test, the power was examined experimentally. 

Tables are appended giving the exact distribution of the c,(R) statistic for all 
possible subsample sizes whose total size is less than or equal to 10 together 
with the corresponding Mann and Whitney U value. Table 2 gives critical values 
of c,(R) for N S 10, p S .10. 


1. Introduction. The problem of testing whether two samples come from the 
same population when either there are observed measurements and no assump- 
tion about the functional form of the underlying distributions or there are only 
ranks of the observations available has been treated by many statisticians. 

H. Scheffé [12] gives an exhaustive and succinct review. of this problem to- 
gether with brief descriptions of proposed solutions offered previous to 1943. 
Included in Scheffé’s references are the well known “runs” test and the modified 
likelihood ratio test of Wald and Wolfowitz [14], [17]. 


1 This paper was presented at the Boston meeting of the Institute on December 26, 1951. 
These results were included in the thesis submitted to the Dept. of Mathematical Statis- 
tics of the University of North Carolina in partial fulfillment of the requirements for the 
degree of Doctor of Philosophy, June 1951. 
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A rank analogue to the standard parametric test. was introduced in 1945 by 
Wilcoxon [16], and a linear function of Wilcoxon’s T was proposed by K. K. 
Matthen [7] in 1946 and its distribution and property of consistency shown by 
Mann and Whitney [6] in 1947. Tables are given by Mann and Whitney [6] for 
values of m, n S 8. 

Implicit in the introduction to Tables XX and XXI of Fisher and Yates [3] 
is a consideration by Fisher and Yates of rank order tests of the type discussed 
and developed in this dissertation. W. Hoeffding [4] develops a general most 
powerful rank order test, and this paper is an application of his results to spe- 
cific problems, with various extensions. 


2. Derivation of the statistic c,(R). Let Z = (Z,, --- , Zw) be arandom vector 
of N components with probability function P(S) = P{Z e S}, and W be the set 
of points (z,, --- , zw) in N-dimensional Euclidean space where z; ¥ z;, 71 ¥ j. 
We shall consider only probability functions such that 


(2.1) P(W) = 1. 


Define Dy to be a class of probability functions P(S) which are invariant under 
all the N! permutations of the Z; and Ho to be the hypothesis that P(S) is in 
D,. In particular Hy may be the hypothesis that Z,, Z:,---, Zw are inde- 
pendent with a common continuous distribution. 

Let R = (7, +++, Tw) be a permutation of the integers (1, --- , N). Let S(R) 
be the subset of W where z; has rank r;, (¢ = 1, --- , N). Let the integer ¢, be 
defined by r:, = i, (¢ = 1,--- , N). Then S(R) is the set where z,, < z,, < --: 


< zy. The set W consists of the M = N! subsets S(R). For the probability 
P(S(R)) of the set S(R) we shall use the short notation P(R). A probability 
function P(S) which is in Do will be denoted by P(S| Ho). Let H, be the hy- 
pothesis that P(A) = P,(A), a probability function of Z not in D,). Denote the 
M permutations R by R,, --- , Rw in such a way that 

P\(R,) = Pi(R;) ifi=1,---,mj=m-+i1,---,M. 
Clearly, (Ri, «++ , Rm) determines a rank order test which is most powerful for 
testing Hy against H;, [4]. 

If the condition (2.1) is not satisfied, we may apply either of the following two 
rules. 

Rule 1. If n of the values Z,; , --- , Zw are less than Z; , and m values are equal 
to Z;, the latter values are assigned at random the ranks n + 1, --- ,n + m. 
This is carried out for all Z; , and Z is treated as belonging to the corresponding 
set S(R). 

Rule 2. Let k be the number of sets S(R) which can be obtained by applying 
1 to a given Z. If exactly:k’ of these belong to the critical region, Hp is rejected 
with probability k’/k. 

It follows from the definition of Do that 


1 
(2.2) P(R | Hy) = N! 
for all R. 
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Consider the alternative where Z,,--- , Zw have the joint density 


N 1 ‘ 
(2.3) 55 &xP |- 3 5 (2; — dit — n) | 


where d,, --- , dy are given constants, not all equal, and &, » are parameters. 
Then 


‘ 1 

(24) P(R) = [+ fT I] Ti exp | - To? (2; — dé — a dz,:--dzy 
tS <tty 

The probability P(R) is independent of » and depends on 6 = £/o only. For if 


we make the transformation 


ian tin ad, (i = 1,---,N), 
oC 


the inequalities z,, < 21, < +--+ < Zty are transformed into 24, < 21, < +--+ < zy. 
Denoting P(R) by P(R, 6), and replacing z; by z; , we have 


(2.5) P(R,8) = [ ++ [Ise — d)8) de +++ dex, 


Bt, < oe Sey 


where 


(2.6) f(z) = Fe exp (- ‘). 


It is easily seen that P(R, 5) has continuous derivatives of any order with re- 
spect to 6. Hence we can write, for any positive integer z 


(2.7) P(R,6) = wy, | oo(®) + c1(R) 5 - + cx(R) > 4 owt |, 


where 


1 _ d'(P(R, 8)) | 
me®.- a he? 


and 0(8‘**) denotes a term of order 5*** as 6 — 0. We shall also write formally 
le é" 
(2.8) P(R, 8) = — > ¢,(R) — 
N! 5=0 n! 


without considering the convergence of the series. 
To obtain the coefficients c,(R) we shall expand the integrand in (2.5) in 
powers of 6 and integrate term by term. 


2 (ng) " 
(2.9) fla — ds) = > fi (e)(—d,8)" 


? 
aad ni! 7 
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where f(z;) is the ,th derivative of f(z,). Then 


‘ (ns) " 
Ise - 48) = 11> {aoe 


tl 9y=0 


ot Ae mh ; act) 


2,=0 2N=0 m! ne! 


we 


~ Fo. n! ! Wary ) (g a - 
=) tl 
; II»! 
tol 
where >. represents the summation over all m,--- , 9 such that 7; = 0, 
i = 1,---, N, and >-4.1 = ». Integrating the final form of (2.10) term by 
term and comparing the resultant expansion with (2.8) we obtain 


(2.11) ¢(R) = uf tee fies Ila —1)" f(z, day +++ dew. 


Bice <tty -+ > 
Consider the following transformation. Let z;, = z;,1 = 1, --- , N, and nowthe 
domain of integration will be (2; < --- < zy). Since by definition t,, = i, i = 

, N, where r; is the rank of z; in S(R), wehavez; = zy, = Zr, . Applying 
this transformation to c,(R) in (2.11) and replacing z; by z;, we have 


(2.12) ¢(R) = N! i -[ a II (- d,)"*f" (z,,) day +++ 
II ni! 


1<***< en 


But 
(2.13) f() = (-1)"H,(2)f@), 


where H,(z) is the nth order Hermite polynomial [1]. In particular, Ho(z) = 1, 
H,(z) = z, H.(z) = 2 — 1. Substituting the appropriate forms of (2.13) in (2.12) 
we have 


(2.14) ¢(R) = N! J. 7 > a Eat ae iil ie sin 
2N n a. 


ton] 
Let Zm S Zy2 S ++: S Zww be the order statistics in a random sample 


of N from a standard normal population. The joint frequency function of 
Zm,°++, Zyw is NIT 2s fe), a <-++ < zw. Hence 


(2.15) ¢(R) = E| ©” x — IL at Wy,(Ze-,) |. 
IIa: 


tal 
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In particular, 


(2.16) e(R) = 1, 
(2.17) a(R) = > d, E(Z wr), 

t= 

N 2 N 
c,(R) = EF }> d; Zn | a Zs di, 
(2.18) ear a v 
= DD did E(Zm, Zn) — Dodi. 
ball tak tae] 


To the order of 6°, P(R, 6) may be written as follows: 
(2.19) PUR, 8) = [1+ es(Rs + a(R) + 068 |. 


If 5 is positive and sufficiently small, the rank order test of size K/N! which is 
most powerful against P(S, 6) is determined by the K permutations R;, i = 
1, --- , K, for which c,(R) takes its largest values. Hence c;(R) is the desired sta- 
tistic for the stated alternative with 6 positive and small. 


3. Asymptotic distribution. It will be proved that under H, the statistic c,(R) 
is asymptotically normally distributed as N — © if the d; satisfy a certain con- 
dition. The proof is based on a theorem of Noether [9] and an unpublished theo- 
rem of Hoeffding which, together with its proof, is reproduced here by per- 
mission. 

A sequence of sequences Ay = (am, -°-- , Gyw), N = 1,2 --- is said to satisfy 
Condition W if as N > ~, 


l< : 
N > & (ani -™ dy) 
4 i=l 

- 


(3.1) rie 7, = O(1), r= 3, 4, ae 
E 2d (ayi = aw) | 

where dy = 1/N }-%_; ay; [15]. Similarly a sequence of sequences satisfies 

Noether’s condition [9] if 

(3.2) Di (awi coe dy) = o(1), r= 3, 4, eee 


[>> (ani - dy)|"* 


Let Dy = (dm,-+:, dwy) and Hy = (hm.--:, hww), N = 1, 2,---, be 
two sequences of sequences of real numbers. Let (2, --- , 2) be the random 
vector whose domain consists of the N! equally probable permutations of 
(hy.,*** , Aww), and let 


Ly = dyyty tees + dynty, 
Lo = Ly — Eo(Ly) 
ais VVo(Ly) ’ 


where Eo(Lw) and Vo(Ly) denote the mean and the variance of Ly. 
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Noether [9] shows that 


(3.3) E, (Ly) = = < dy; > hy: = Ndyhy, 


tal 


(3.4) ‘(Li — a 4 © — dy)? > (hs — hw)’, 

and that if the sequence Hy satisfies Condition W, and the Dy satisfies Noether’s 

condition, Ly has a normal limiting distribution with mean 0 and variance 1. 
The statistic c,(R) (2.17) can be written 


N 
Cy (R) — zB d, hy, ’ 
tal 


where 
(3.5) h; = hyi = E(Zyi). 


(The d; = dy; may also depend on N; to simplify the notation we write d; , h; 
for dyi, hyi). Under Ho the N! permutation of (hk, , --- , hy) are equally prob- 
able, so that c,(R) = Ly, with hy; defined by (3.5). 

Hoeffding shows that the sequences Hy = (hi,-::, hy) = (EZm,--- 
EZyw) satisfy Condition W as follows. 

It is easily seen from the symmetry of the normal distribution that h,; = 
EZy; = —EZwwu-i = — Nasi. Hence 


(3.6) > hi = Oif r is odd. 
tal 


In particular hy = 0. Hence it suffices to show that 


ee 
N en as O(1) 


lz 2 ; ‘| 


If r = 2k is even, we have 
N 


N 
(3.7) Dh = . (EZyi)™ D> E(Zy)™ = ED Zs, 


tel tal tol 


and 
(3.8) E>~Zyi = NEX®, 


where X is standard normal. Equation (3.8) holds since a symmetrical function 
of the order statistics is distributed as the same function of the unordered in- 
dependent variables. 
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If m = [N/2] is the largest integer S N/2, we have by Cauchy’s inequality 


(3.9) Dh =2 > iz? ( > hn) = 2( > EZ) 


tex 1 i=_N—m+1 i=N—m+1 i=_N—m+1 


Let F(z) = [ fly) dy. Then for1 Sk SN —1, 


2 Baw = YN (NT 1) f e@r@i ta — Feyy az 


tmk+1 imk+1 1 


= yf af (x) 7 : ') trent - F(x)|""*? dz. 


Since OV("F (F(x) — F(x)\**” is the remainder after k terms of 
the binomial (F(x) + 1 — F(x))”~, we may express [5] this remainder as the in- 
complete Beta function 


(N — 1)! - k-1 N-I-k 
k- Du — Tmt ea ae 


(3.10) 


Hence 
N 


>, EZ 


t=mk+1 


some (N — 1)! ee. . ee 
re [. f(z) (k — 1)1(N yl er " — 4) dt dz. 


(3.11) 


Integrating by parts we obtain 
N 


Dd Ezy: 

texk+1 
(3.12) 
a 
~ (kK —1I!I(N-—k-D! 
Since F(—z) = 1—F(x) S x f(x) for x > 0, there exists a constant K > 0 
such that 


(3.13) f(x) 2 KF(x)[1—F(2)] for all x. 
For let c > 0; then 


[ (f(a) [(Fx))* [1 — F(x)}¥"** dz. 


IV 


f(z) 
a= mut F@ll — F@) 
For xz > ¢, f(x) > 2{1—F(x)] = 2z[l1—F(x)|[F(x)] = cF(x)[1—F(x)]; and by 
symmetry the same inequality holds for x< ce. Hence we can take K = min (c, d). 


Ni 
EZy; = : 
- i “4 DIN — 


> 0. 


=p [_f@lr@rt - Fay az 
(3.14) 

Kew - 
NF 1 
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Whence from (3.9) 
(3.15) 


where k’ is a positive constant. Then by (3.7), (3.8) and (3.15), 
N N 
(3.16) TURE LM)? s Bey = 01, 
4 i=] tal 
whence it follows that EZm,, --- , EZww satisfies Condition W. By (3.3), (3.4), 
and (3.5) we have 


E,(a(R)) = 0, 


(3.17) Volex(R)) = Ep(ex(R))* = vu iv’ (d; — d)’ > hi. 


tal 


We now obtain from the theorem of Noether: 


TueoreM. If the sequences (d,,--- , dw), N = 1, 2, +++ satisfy Neother’s con- 
dition, then under Ho 


a(R) By & Blur 
E(c(R))? - . 5\2 ~ 2 
et yoy &- OL Een) 


t=1 


has a limiting normal distribution with mean 0 and variance 1. 


4. Approximate distribution. Pitman [10], [11] has proposed the following 
approximation of the distribution of a statistic of the type of c,(R) when the per- 
mutations are equally probable. We now assume without loss of generality that 
>. = d; = 0. Let 


r=r(R) = 2 a = x(R) 


N N . —  —s 
YPraTR PLAY Een 
tml t=] tal a | 


We shall first show that the odd moments of c,(R), and hence those of r, are 
zero. If R = (n, +--+, tw), let R’ = (N+1—1n,-°-,N+1— ry). Leth = 
EZy;, then —h; = hws: ; and we have 


e(R) = da h,, = — vd, hysir, = —¢:(R’) for all R. 


tol 


From the above it follows that 
(4.1) o,(R)** = — o(R’)*™. 


Hence 


1 1 ' 
(4.2) E, [ex (R)] _ oa Wi alk mn a a , c(R ee 








354 MILTON E. TERRY 


Since summation over all FR is equivalent to summation over all R’, we obtain 


(4.3) E,le(R))"** = — = Dh a(R)** = —Eyle(R)|"*, 
4 * R’ 

and thus 
(4.4) Ee(R)|"** = 0,  Eg(r**") = 0. 
It follows from (3.16) and from Pitman’s results that 

; 1 
(4.5)  Ex(r’) = 7 

; W-—-DN-2) bk & 
4 Eo(r*) = —— Seaman al 
(46) Bxlr') = Dey $ 5 | +“Syw-1l" 'B BI. 
where 

] N 
ky = N a d da’ 


par N Bas. N-1 2 ' 
=< (N — 1)(N — 2)(N — 8) | +0 Da = N (Xi) |; 


and kz, ky are the corresponding functions of the h; (k; and k; are Fisher’s 


k-statistics). 

Since r has the form of a correlation coefficient, we have —1 S r < 1, and 
E,(r**") = 0, Eo(r*) = 1/(N — 1). If the last term in the square brackets of (4.6) 
is small compared with 1, we also have E,(r*) = 3/{((N — 1)(N + 1)] approxi- 
mately. 


The distribution with the frequency function 





x 1 


l 2\4N—2 
——— 1 a o 
(4.7) plains BG, IN — iL | x’) 


\0, elsewhere 


IIA 
IIA 


has its odd moments equal to zero, and its second and fourth moments, respec- 
tively 1/(N — 1) and 3/[((N — 1) (N + 1)]. 

For this reason the distribution g(z) may be a suitable approximation of the 
distribution of r under Ho . In Section 7 it is shown that, in the case where the 
d; take on two values only (two-sample test), the approximation is satisfactory 
even for small values of N. Since the distribution g(x) may be a suitable approxi- 
mation to the distribution of r, we can expect the Student’s distribution with 
N — 2 degrees of freedom also to approximate the distribution of (r/+/1 — r*) 
WN — 2. Thus we can obtain the approximate critical values of c:(R) from the 
t tables. 





5. Two-sample statistic c:(R). Let Hy be the hypothesis that two samples of 
m and n observations come from the same continuous population. In this sec- 
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tion the rank order test of H» will be considered which is most powerful against 
the alternative that the two samples come from two normal populations with 
common variance o° and different means w:., and w:.2 with 6 = (ui2 — ma)/¢ 
sufficiently small. 


The hypothesis Hy implies that the joint distribution of the N = m + n vari- 
ables is invariant under all permutations, and that P(W), the probability that 
all NW values are different, is one. Hence the assumptions about Ho in Section 2 
are satisfied. The alternative is a special case of the distribution (2.3) with 


dé +9 = wa, 
dnt +7 = m2, 
If dj = —n/(n + m),i = 1, +++, m3 dnyj = m/(n + m),j = 1,---,n, then 
d = Diid/N = 0, 
= 1.2 — Mil, 


(5.1) _ Mir. + N12 
, m+n ’ 
a =. ms — M3 
o o : 


Then, from (2.17), 


e(R) = - 22> Ean) +2 > - E(Zyr,) 


-2Y Bem) + - E(Zwr,) 


> E(Znres;)s 


j=l 


6. Asymptotic distribution of two-sample c,(R). 
TueEoreM. If Ho is true, the variance of c,(R) is 


(6.1) Vile(R)) = NW i 2 ean 


If there exist two constants k, k’,0 < k < k’ < 1, such thatk < n/N < k’ 
as N — ~, then 


= 


V NW = 5% (EZy,)° 


has a normal limiting distribution with mean 0 and variance 1. 
Proor. Relation (6.1) follows from (3.16) since 


¥ dw — de) = Do cy See 
— dyi oe ) = ni = —z sta (m + n)? 


Se RCRA I AEA EIIIOE ERO NSIT SAC ATTRA SLAIN te 
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By the theorem of Section 2 it now suffices to show that 


N 
~ dyi 
aa = 0(1), r= 3,4, °°: 
P ds | 
tol 
This follows from the relations 
N 
(6.2) Dds = 
tel N 
and 
N r r 
(6.3) > dhi = m (-z) +n (2) = N“[nm’ + (—1)’mn’}. 
i=l 4 4 
Hence 


N 
pm dyi v/2 r/2 
——— =n (*) + (— 1)"m (*) = o(1), f= 3, 4, cee, 
a, 4 4 


since the inequality 0 < k < n/N < k’ < 1 impliesO < 1 — kh’ < m/N < 
1-—-k<1. 


7. Approximate distribution of two-sample c,(R). In Section 4 we have con- 
sidered the approximation of the distribution under Ho of 


e:(R) 


CE, eee ee 
V > did (EZy,)° 
tanl tel 


by the distribution (4.7). In the two-sample case 


e:(R) 
7 mn = : 
=~ 2, (EZwi)* 
i N 1 
(7.1) 
E,(r’) = nt. 
mw’ N=1? 
and 
E,(r‘) 


se E 4 (N + 1)’ (= =2.. ._ es - 3(N =?)] 
 Nt=1 3N(N — 2)(N—3)\ mn N+1)\i N+1/) 


Thus when the second term within the square brackets is small compared with 1, 
the distribution (4.7) can be expected to approximate the distribution of r. 
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If X has the distribution g(x), (4.7), then X~/ N — 2/+/1 — X? has Student’s 
t-distribution with N-2 degrees of freedom. Hence the latter distribution will 
approximate the distribution of rx/N — 2/+/1 — r®. The ¢ approximation to the 
critical values of ¢;(R) at the level a of the c:(R) test for given N, n, m, ue is 


(7.2) Che = { / ty-2,.20 MMe 
ty-2%at+mt+n—2 


where ty_2,2« is the tabular value of t with N — 2 degrees of freedom at the level 
2a in the Fisher and Yates Table III [3]. 

The ¢ approximation is very good for N as small as 6 insofar as comparisons 
of fourth moments and critical values are concerned. Shown below are the 
critical values, ¢:,2, a8 obtained from the exact distributions for the level of 
significance a = .05 and from the ¢ approximation for the level a = .05, together 
with P{e (R) 2 ci}. 





A comparison of critical values 


| Cla P{ex(R) = 1,4} 
Nm mn 

Exact | t ier ee or Exact t 
6 3 3 | 1.81 2.11 | .05 .05 
725 } 1.80 |) ak, iowa 05 
7:34 1.97 | 2.11 | .057 .057 
8 3 5 z 2.08 | .053 .053 
8 4 4 2.07 | 2.15 | .087 .057 
9 3 6 2.33 [ei 047 | .047 
9 4 5 2.42 2.29 | .048 | .056 
10 4 6 2.54 2.40 .048 .052 
100 5 5 2.58 2.45 


-048 048 








| 


8. Exact distribution of two-sample c,(R) for small N. The exact distribution 
of c:(R) has been computed for small values of N, n,m; N S 10 using the Fisher 
and Yates tables [3]. These distributions are displayed in Table 1, and the 
values of c,(R) and U (cf. Sec. 9) are shown for the yC, distinct permutations 
of (11, +++, 2m, Yis*** > Yn), M+ n =N. Since the probability of each such 
permutation is 1/yC, , these probabilities are not explicitly stated in the table. 
Since only the relation between z and y matters, we will replace each z; by a 0 
and each y; by a 1, following the simplifying notation of Wolfowitz [14]. Each R 
will thus be represented by a sequence of m 0’s and n 1’s. As the values of c:(R) 
for N, m, n and N, n, m are symmetric, the table will show the distribution 
for subsample sizes m, n; m S n. The probability, under the null hypothesis 
that a sample of m 0’s and x 1’s will give rise to a value of c,(R) exceeding or 
equaling the tabulated value of c,(R) is given in Table 2 for values of p < 0.10, 
and is available for tests of significance when 6 S N S 10. 
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TABLE 1 
Ezact distribution of C,(R) 
Exact distribution of c,(R) for distinct permutations of R, for given N, m,n; m Sn, 


together with corresponding values of Mann-Whitney U test [6]. The value of c,(R) is tab- 
ulated under the column heading c; . 























































R Ci U R Ci U | R C1 U R Ci U 
N=2 m=1 | 01110 .6¢ 3] 0110110 .00 6 | 11000111 .47 6 
01 56 0; o1001 483 4) N=8 m=2 | 10011101 .47 6 
N=3 m=1 | 010110 .20 4 | OO11111 2.27 © | 01110101 .42 7 
O11 .85 0 100101 .20 «4 | O1011111 1.89 1 | 10110011 .23 7 
101 .00 1| N=7 m=1 QUOI 1.57 2 | O1101110 15 7 

N=4 m=1 O111111 1.35 0 | 10011111 1.32 2 | 
0111 1.03 © | 1011111 .76 1) 01110111 1.27 3) yj001011 .15 7 
1011.30 «61 1101111. 352 10101101 .15 7 
N=4 m=2 | 1110111 .00 3] 10101111 1.00 3] 01111001 .10 8 
0011 1.33 0) N=7 m=2 | o111011 95 4| N=8 m=4 
0101.73) 1 |) «(OOLNN11 «2.11 0 | 40110111 + .70 «4 | 00001111 2.89 0 
O10 00-2 | = O1O1111 «1.70 1 | 43001111 62 4 | OOO1II] 2.59 1 
N=5 m=1 | O10111 1.35 2) 01111101 .57 5 | 00100111 2.27 2 
Oll11 1.66 0O 1001111 1.11 2 | 00011011 2.27 2 
10111 50 1] £40111011 1.00 3 } 10111011 .38 5 00101011 1.95 3 

non © 2) | 11010111 .32 5 

wos Set 1010111, .76 = 3 | «41100111 -.00 «6 | +4(01000111 1.89 3 
: OOlll 1.66 0 | 0111101 .59 4) 11011011 .00 6 | 00011101 1.99 3 
O1011 1.16 1 | 1011011 41 4 | «40111101 = .00 «6 | «(00110011 1.65 4 
O1101 66 2 | = 1100111 .35 4 | «91111110 00 «6 | 01001011 1.57 4 
10011, 50 2 |) 1101011. 00 5 | N=S m=3 | OO101I01 1.57 4 

01110 00 8 1011101 =.00 =©5 | Qooli111 2.74 0 | 
§ y ne hips ‘g | N=7 m=3 | 00101111 2.42 1 10000111 1.32 4 
; Oll111 1.27 0 0001111 2.46 0 | OO110111 2.12 2 | Qoo1i110 1.32 4 
se | 0010111 2.11 1 01001111 2.04 2 | 91010011 1.27 5 
ee = 1) 0011011 1.76 2| oo111011 1.80 3 | ol10101 1.27 5 
oon, cuosie fl ie s 7 5 | 01001101 1.19 5 

OO1111 1.91 0 “ | 01010111 1.74 3 | 
Q10111 1.47 1 | 10001111 1.47 3 | 0001011 1.00 5 
011011 1.07 2 | 101011 1.35 3 | OO111101 1.42 4 | Qo101110 1.00 5 
100111 .84 2 | 1000111 1.11 3 | 01100111 1.42 4 | 01100011 .95 6 
11101 63 3 0110011 1.00 4 | 01011011 1.42 4 | 00111001 .95 6 
| 0101101 .94 4 | | 01010101 .89 6 

01011644. «3 | «(00101 «764 | 0N0111 1.17 4 | 
011110 .00 4 | | 01101011 1.10 5 | 40010011 .70 6 
101101 .00 4 0011119 .76 4 | 01011101 1.04 5 | 00110110 .70 6 
Naf m= 3 0110101 + .59 5 00111110 .85 5 | 40001101 .62 6 
000111 2.11 O 1010011 .41 5 | 10011011 85 5 | 01001110 .62 6 
001011 1.71 1 | 001101 .35 5 | 01100101 .57 7 

010011 1.27 2) 0101110 .35 5 | 0100111 .85 5 | 
001101 1.27 2 01110011 .80 6 | 01011001 .57 7 
010101 .83 3 | 0111001 .24 6 | 01101101 .72 6 | 10100011 .38 7 
1100011 .00 6 | 10101011 .53 6 | 00111010 .38 7 

00 6) 47 6 


100011 .64 3 1010101 01011110 


10010101 
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TABLE 1—Continued 





R Ci U R “Ci U R C1 U | R Ci U 

















01010110 .32 7 | 010000011 1.49 5 | 001011011 2.12 4 | 001111010 .36 9 
001000101 1.49 5 | 000111101 2.06 4 | 
01101001 .25 8 | 000101001 1.49 5 100110101 .30 9 
10001110 .05 7 | 000100110 1.23 5 | 010010111 2.06 4 | 010110101 .30 9 
11000011 .00 8 | 001101011 1.85 5 | 011100101 .29 10 
10100101 .00 «8 | 000110001 1.22 6 | 010100111 1.79 °5 | 100011110 .28 8 
10011001 .00 8 | 000011010 1.20 5 | 100001111 1.77 4 | 110001011 .27 9 
| 001001001 1.19 6 | 001011101 1.76 5 
01100110 .00 8 | 010000101 1.13 6 | | 101001101 .27 9 
01011010 .00 8 | 100000011 .93 6 | 010011011 1.76 5 | 011001110 .27 9 
00111100 .00 8 | 001110011 1.58 6 | 011011001 .26 10 
N=9 m=2 | 001000110 .93 6 000111110 1.50 5 | 101100011 .09 10 
001111111 2.42 © | 000101010 .93 6 | 100010111 1.50 5 | 100101110 .01 9 ‘ 
O1O111111 2.06 1 | 001010001 .92 7 | 011000111 1.49 6 
011011111 1.76 2 | 000011100 .84 6 110010011 .00 10 
100111111 1.50 2 | 010001001 .83 7 | 001101101 1.49 6 | 901111100 .00 10 
011101111 1.49 3 | 010101011 1.49 6 | 100111001 .00 10 
000110010 .66 7 | 010011101 1.40 6 | 101010101 .00 10 
101011111 1.20 3 | 001100001 .65 8 | 100100111 1.23 6 (0101110101 .00 10 
101101111 .93 4 | 001001010 .63 7 | 001110101 1.22 7 | 
011110111 .92 4 | 100000101 .57 7 10011101. 10 
11111011 .92 5 | 000101100 .57 7 | o10110011 1.22 7|N=10 m=2 
110011111 84 4 | 001011110 1.20 6 |%1I1I1111 2.54 0 
010000110 57.7 | 100011011 1.20 6 |9101111111 2.20 1 
101110111 .66 5 | 010010001 .56 $8 | 011001011 1.19 7 |OLIOLILIII 2.20 2 t 
110101111 57 5 | 001010010 36 «8 | O10101101 1.13 7 |0O1LIII11 1.66 2 
Q11111101 .56 6 | 000110100 .30 8 | CHOI 1. 8 
101111011 .36 6 | 010100001 .29 9 | 101000111 .93 7 | : 
110110111 .30 6 001101110 .93 7 reeeliads eo : 
| 100001001 .27, 8 | 100101011. 93 7 |oriass0111 1.16 5 
111001111 .27 6 | 010001010 27) 8 | 001111001 92) 8 |ioriorya11 1 12 4 
111010111 .00 7 | 001001100 .27 | 8 | 011010011. 92) 8 jiyooiiy31 104 4 
110111011 .00 7 | 001100010 .09 9 | 
101111101 .00 7 | 100000110 .01 8 | 010110101 86 8 |1011101111 .88 5 
011111110 .00 7 | 010011110 .84 7 |9111111011 .88 6 
N=9 m=3 | 100010001 .00 9 | 100011101 .84 7 |y;01011111 .78 5 
000000111 2.99 0 | 010010010 .00 9 | 011001101 .83 8 |4913110111 .62 6 
000001011 2.69 1 | 001010100 .00 9 | 001110110 .66 8 |;391101111 .54 6 
000010011 2.42 2 | 000111000 .00 9 | 
000001101 2.33 2/ N=9 m=4 | 100110011 .66 8 [0111111101 .54 7 
000100011 2.15 3 | 000011111 3.26 0 | 011100011 .65 9 |1110011111 .50 6 
000101111 2.99 1 | 101001011 .63 8 |1011111011 .34 7 
000010101 2.06 3 | 000110111 2.72 2 | 110000111 .57 8 |1101110111 .28 7 
001000011 1.85 4 | 001001111 2.69 2 | 100101101 .57 8 |1110101111 .26 7 
000100101 1.79 4 | 000111011 2.42 3 | 
000001110 1.77 3 | 010101110 .57 «8 {1111001111 .00 8 
000011001 1.76 4 | 001010111 2.42 3 | 011010101 ,56 9 |1110110111 .00 8 
010001111 2.33 3 | 010111001 .56 9 |1101111011 .00 8 
000010110 1.50 4 | 001100111 2.15 4 | 101010011 .36 9 |1011111101 .00 8 
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TABLE 1—Continued 








R Ci U R Ci U R Ci U R Ci U 
0111111110 =.00) 8 0101111110 .66 8 {0110001111 1.92 6 (1010011011 .84 9 
N = 10 m= 3 (0111011101 .66 9 |0010111101 1.92 6 |0101110101 .82 10 
0001111111 3.20 0 {1011100111 .50 9 |0100111011 1.92 6 |0110101101 .80 10 
OO1LOLII111 2.92 1 (0111110011 .50 10 /0011101011 1.76 67 | 
OOLLOLII11 2.66 2 1011011011 .46 9 | 1100010111 .78 9 
0100111111 2.58 2 : }0101100111 1.70 7 |1001011101 .7 9 
OO11101111 2.42 3 (0111101101 .42 10 {1001001111 1.66 6 |0101011110 .78 9 
}1101010111 .40 9 |1000110111 1.66 6 |1001011110 .78 10 
0101011111 2.32 3 |1110001111 .38 9 {0001111110 1.66 6 {1011000111 .62 10 
0011110111 2.16 4 |1100111011 .38 9 ,0110010111 1.66 7 
O1O1101111 2.08 4 | 1010111101 38 9 | 1001110011 .62 10 
~ 1000111111 2.04 3 0101011011 1.66 7 (0011110110 .62 10 
O11OO11111 2.04 4 0110111110 .38 9 (0011011101 1.66 7 (0111010011 .62 il 
1011101011 .22 10 {0100111101 1.58 7 |1010101011 .60 10 
0011111011 1.88 5 (1101100111 .16 10 |0011110011 1.50 8 |1100100111 .54 10 
0101110111 1.82 5 (0111110101 .16 11 (0110100111 1.42 8 
0110101111 1.80 5 (1001111110 .12 9 1001101101 .54 10 
1001011111 1.7 4 0101101011 1.42 8 0101101110 .54 10 
1001101111 1.54 5 {1110010111 .12 10 |0011101101 1.42 8 {0111001101 .&4 I11 
1101011011 .12 10 (1001010111 1.40 7 (0110110101 .54 11 
O111001111 1.54 6 {1011011101 .12 10 |1010001111 1.38 7 (0101111001 .54 11 
i 0110110111 1.54 6 (0111011110 .12 10 | 1000111011 a 67 
: 0101111011 1.54 6 (1100111101 .04 10 }1000111110 .50 9 
: 0011111101 1.54 6|N=10 m=4 0010111110 1.38 7 |1100011011 .50 10 
; 1010011111 1.50 5 |OOOO111111 3.58 0 |0110011011 1.38 8 |1010011101 .50 10 
0001011111 3.32 1 (0101011101 1.32 8 {0110011110 .50 10 
j 1001110111 1.28 6 (0001101111 3.08 2 (1001100111 1.16 8 (0111100011 .38 12 
0111010111 1.28 7 (0010011111 3.04 2 0111000111 1.16 9 
1010101111 1.26 6 (0001110111 2.82 3 1011001011 .34 11 
0110111011 1.26 7 0101110011 1.16 9 |1010110011 .34 11 
0101111101 1.20 7 (0010101111 2.80 3 {0011110101 1.16 9 (0011111010 .34 11 
0100011111 2.70 3 {0110101011 1.14 9 {1101000111 .28 11 
1100011111 1.16 6 |OO11001111 2.54 4 (1010010111 1.12 8 {1001110101 .28 11 
O111100111 1.04 8 (0010110111 2.54 4 1001011011 1.12 8 | 
1011001111 1.00 7 (|O0001111011 2.54 4 0101110110 += .28 11 
1010110111 1.00 7 0011011110 1.12 8 (0111010101 .28 12 
1001111011 1.00 7 |0100101111 2.46 4 |0101101101 1.08 9 |1100101011 .26 11 
0011010111 2.28 5 (1100001111 1.04 8 /|1010101101 .26 Il1 
0011111110 1.00 7 (0010111011 2.26 5 1000111101 1.04 8 0110101110 .26 11 
0111011011 1.00 8 (0101001111 2.20 5 0100111110 1.04 8 
1100101111 .92 7 |0001111101 2.20 5 /0110111001 -26 12 
0110111101 .92 8 0110011101 1.04 9 (1100011101 .16 11 
0111101011 .76 9 (0100110111 2.20 5 |1010100111 .88 9 1011010011 .08 12 
1000011111 2.16 4 |1001101011 .88 9 |0111100101 .04 13 
1011010111 .74 8 0011100111 2.04 6 0011101110 .88 9 |1001101110 .00 11 
1010111011 .72 8 (0011011011 2.00 6 0111001011 .88 10 
1101001111 66 8 0101010111 1.94 6 1110000111 .00 12 
1100110111 .66 8 0110110011 + .88 10 |1101001011 .00 12 
1001111101 66 8 1000101111 1.92 5 0011111001 .88 10 {1100110011 .00 12 
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TABLE 1—Continued 














Roa U Ra u| a ' 8 Roa U 
sitll ated | i . 
1011001101 00 12 [0010011101 2.04 6 |0100011110 1.16 8 0011100110 .50 11 
1010110101 .00 12 |oo1s001011. 1.88 7 | (0011110001 .50 12 
(0010110011 1.88 7 (0101100011 1.04 10 |0111000011 .50 12 

1001111001 .00 12 [0101000111 1.82 7 0011100101 1.04 10 | 
0111001110 .00 12 |0001110101 1.82 7 |1010000111 1.00 9 |1010010011 .46 11 
0110110110 .00 12 1000110011 1.00 9 |0011011010 .46 11 
0101111010 .00 12 |0100101011 1.80 7 |1001001011 1.00 9 |0110100101 .42 12 
0011111100 00 12 |0010101101 1.80 7 0101101001 .42 12 
1000010111 1.78 6 |0011001110 1.00 9 |1001010101 .40 11 

0111011001 .00 13 0001011110 1.78 6 {0010110110 1.00 9 | 
N=10 m=5 |0100011101 1.70 7 |0001111010 1.00 9 |0101010110 .40 11 
0000011111 3.70 0 | (0110010011 1.00 10 |1000101110 .38 10 
0000101111 3.46 1 [0011010011 1.62 8 [0011011001 1.00 10 |1100001011 .38 11 
0000110111 3.20 2 |1000100111 1.54 7 1010001101 .38 11 
0001001111 3.20 2 [0001101110 1.54 7 |0101010101 .94 10 |1000111001 .38 11 

0001010111 2.94 3 |0110000111 1.54 8 0100101110 .92 9 
0101001011 1.54 8 |1000101101 .92 9 |0110001110 38 11 
0010001111 2.92 3 | 0110001101 .92 10 [0100111010 .38. 11 
0000111011 2.92 3 |0100110011 1.54 8 |0100111001 .92 10 |0010111100 .38 11 
0001100111 2.70 4 |o011001101 1.54 8 | 0110011001 .38 12 
0010010111 2.66 4 0010110101 1.54 8 |0110100011 .76 11 |1010100011 .22 12 

0001011011 2.66 4 |0001111001 1.54 8 |0011101001 .76 11 
1000011011 1.50 7 |1001010011 .74 10 0011101010 .22 12 
QOOOII1101 2.58 4 | 0011010110 .74 10 |1001100101 .16 12 
0100001111 2.58 4 |0010011110 1.50 7 |1010001011 .72 10 [0101100110 .16 12 
0010100111 2.42 5 |0100101101 1.46 8 (0111000101 .16 13 
0001101011 2.42 5 |0011100011 1.38 9 |0010111010 .72 10 |0101110001 .16 13 

0010011011 2.38 5 |1001000111 1.28 8 0101100101 .70 11 
0001110110 1.28 8 |1001001101 66 10 [0110101001 .14 13 
O100010111 2.32 5 | 1000110101 66 10 |1001001110 .12 11 
0001011101 2.32 5 |0101010011 1.28 9 {1100000111 .66 10 |1000110110 .12 11 
0011000111 2.16 6 {0011010101 1.28 9 1100010011 .12 12 
qosriy0ort 2.16 ¢ |mo0niaiotI 1.28 laimwootie 68 18 jnononmmnet 13 12 

0010101011 2.14 6 0010101110 1.26 8 |0100110110 .66 10 
(0010111001 1.26 9 |0001111100 .66 10 |0110010110 .12 12 
0100100111 2.08 6 | 0110010101 .66 11 |0101011010 12 12 
0001101101 2.08 6 |0110C91011 1.26 9 |0101011001 .66 11 \0011011100 .12 12 
0000111110 2.04 5 0101001101 1.20 9 1001011001 .12 12 
1000001111 2.04 5 |0100110101 1.20 9 |1000011110 .62 9 |1100001101 .04 12 
0100011011 2.04 6 |1000011101 1.16 8 1001100011 .50 11 0100111100 .04 12 


9. The c,(R) test compared with Mann and Whitney U test. The two best 
known rank order tests now in current use for testing whether two samples come 
from the same population are the Mann and Whitney U test [6] and the Wil- 
coxon T' test [16]. These two tests have been developed to test the null hypothesis 
that the sample (z:, --- , 2m) comes from the same population as the sample 
(y1,-** , yn) With cdf F(£) against the alternative that the cdf of (yi, --- , ys), 
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TABLE 2 
Critical values of c,(R) 
Listed below are the critical values of c,(R) tabulated as c, for the two- 
sample case for values of NV, m such that 6 S N s 10,1 < m S [N/2], together 


with the probability (p) of exceeding this value on the null hypothesis, where 
p = .10. 








Nm C1 P Nm C1 Pp Nm C1 p 
6 3 2.11 .050 9 2 2.42 .028 10 3 3.20 .008 
1.71 .100 2.06 .056 2.92 .016 
1.76 .083 2.66 .025 
2.58 .033 
7 2 2.11 .048 9 3 2.99 .012 2.42 .041 
1.70 .095 2.69 .023 2.32 .050 
2.42 .035 2.16 .058 
7 3 2.46 .029 2.33 .048 2.08 .067 
2.11 .057 2.06 .071 2.04 .083 
1.76 .086 1.85 .083 1.88 .091 
1.79 .095 1.82 .100 
8 2 2.27 .036 9 4 3.26 .008 10 4 3.32 .010 
1.89 .071 2.99 .016 3.04 .019 
2.69 .032 2.80 .029 
S 3 2.70., o16 2.42 .048 2.70 .033 
2.42 .036 2.33 .056 2.54 .048 
2.12 .054 2.15 .063 2.28 .057 
2.04 .071 2.12 .071 2.20 .076 
1.80 .089 2.06 .087 2.04 .086 
1.85 .095 1.94 .095 

8 4 2.89 .014 

2.59 .029 10 2 2.54 .022 10 5 3.46 .008 
2.27 .057 2.20 .067 2.92 .028 
1.95 .071 2.66 .040 
1.89 .100 2.58 .048 
2.32 .067 
2.14 .079 
2.08 .087 








G(é) have the relation F(¢) > G(é) for every ¢. The U test has been shown to be 
equivalent to the Wilcoxon 7 test [6]. In fact Mann and Whitney show the 
following linear relation between the U statistic and the 7 statistic: 





(9.1) U = mn + 3(n)(n + 1) — T. 
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The U test has been defined by Mann and Whitney as follows. In an ordered 
sample of m z’s and n y’s, let U count the number of times a y precedes an z. 
If P(U < U) equals a under the null hypothesis, the test will be considered 
significant at the significance level a if U < U and the hypothesis of identical 
distribution of x and y will be rejected. Wilcoxon’s T is the sum of the ranks in 
the sample of n observations. 

The c,(R) test is generally more sensitive than the U test or the equivalent T 
test, for in many permutations where U(R,) = U(R;), a(R: ¥ a(R;), i ¥ J, 
with the result that although 


P{U s U(R,)} = P{U s U(R))}, 
P{e(R) = «(R)} ¥ P{e(R) = a(R}, t ¥ j. 


The most powerful test is not difficult to compute, as it involves at most n addi- 
tions or subtractions of numbers readily accessible in the Fisher and Yates tables 
[3]. Table XX tabulates for N s 50 the positive values of EZy;. 

There is a very close dependence between these two statistics, as a scrutiny 
of Table 1 will show. For all N S$ 8, m 2 1, U is a nonincreasing function of c , 
and for all N, m = 1, U is a strictly decreasing function of c,; . In general, how- 
ever, there is no such functional relationship. We shall now derive the cor- 
relation under Hy between the U and the c, statistic. 

By definition [3], the correlation pic,(R), U] can be written 


__Folex(R)U) __ 
ple,(R), U] = Vole(R)V(U))* 


Since there is a linear relation [6] between the Mann and Whitney U and Wil- 
coxon’s T, to wit: U = mn + 34m(n + 1) — T, it follows that 


(9.3) VU) = VAT), Eolax(R)U) = —Eo(ex(R)T), 


(9.2) 


where T is the sum of the ranks of the sample of n observations. We shall use 
Wilcoxon’s statistic to evaluate Eo(c,(R)U). Now 


m+n min 
(9.4) E,(e(R)T) = a x ( he BZw.) ( >» ni), 
NUn i=_m+1 j=m+1 
where >, denotes the summation over the yC, distinct combinations. Consider 
an r; = k fixed. Then the coefficients, EZy,,; , of k in the summation occur y_:C,-; 
times if r; = k, and y_2C,_2 times if r; ¥ k. Since pp» oF kEZy,, = 0, the coeffi- 
cient of k reduces to (w-iCn — n—2Cn-2)EZy, . Hence it follows that 


1 Sn 
E(e(R)T) = — (vaCna — y-2Cn—2) 2, KE(Zn) 
i NUa kewl 
(9.5) m 
mn 
~ N(N—-D) 2, EZ wn. 
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Now 
> ibZn = iN dg 1) f° esrcann — Feat" ae 
(9.6) ™ . 


= N(N — 1) [ af(z)F(2) dz, 


after interchanging the order of summation and integration and using the 


well known properties of a binomial. Integrating the right-hand side by parts 
we have 


02) Lit = NW - 1) [tet ae = “AE. 
Now 

(9.8) VU) = VT) = Se 

(6] and . 

(9.9) Vole(R)) = 





ee 


where p2 = >,(EZy;)’/N. Since Ey(R) = 0, the covariance of ¢,(R) and T is 
equal to Eo(c,(R)T). Hence 





2 5 3(N — 1) 
9.10 es A ne V aN FD 
me : my [/ N+1_ w(N + 1)us 
12(N — 1)” 
It has been shown in an unpublished paper of W. Hoeffding that 


jim > (EZy,)°/N = 1, and hence iim p = —V/3/e = —0.9772050. 
Thus there is not a linear functional relationship between these two statistics. 
We do, however, note that, for any given N, p is independent of the subdivision 
of N into groups of m and n,m +n = N. 
Numerical values of p can then easily be computed using Tables XX and XXI 
of Fisher and Yates [3]. From numerical calculation, |p| > .99, N S 15. 


10. The power of the c,(R) test. Since no method has yet been found for 
evaluating analytically the power function of the c,(R) test, the power of the c,(R) 
test has been investigated by drawing two random groups of samples of size 
N =8,m = 4,n= 4 foré = 0, .1, 2, .3, 4, .5, 6, .7, 8, .9, 1.0, 1.2, 1.5, 2, 
2.5, 3, 4. The samples were drawn by selecting 100 groups of eight pairs of digits 
except the pair 00 from the Fisher and Yates tables of random numbers [3]. 
These pairs were uniformly distributed over the range 1-99. These 800 pairs of 
two-digit numbers were then transformed into standard normal deviates x 
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using the relationship F(z) = [ f(z) dz, where F(z) = (01) (N), Ni = 
1, «++, 99. 

The first four pairs in each group became the y sample and the last four 
pairs became the xz sample. Then a constant, 5, was added to each value of y 
and the ¢,(R) test carried out. The results were plotted as number of times the 
H, (Section 5) was accepted per 100 against 6, and a smooth curve fitted to the 
pairs of points. 

Neyman and Tokarska [8] give tables of the power function of the one-tailed 
Student’s ¢ test for levels of significance a = .05 and .01. Although the sampling 
procedure yields the approximate power function for a = .057, and the Neyman 
and Tokarska power function is given for a = .05, general comparisons can be 
made on the evidence of shape. No attempt is made to compare actual values. 

We can place confidence limits on 6(6), the actual value of the power, and eval- 
uate the reliability of the sampling estimates of 8(5). Let M be the total number 
of observations and s the number of observations that lead to rejection. Then 
s has a binomial distribution with parameters M and 8(6), and E(s) = MB((4); 


V(S) = Ma(s)(1 — B(6)). 
AFA wat 
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Figure 1 shows the power curve of the one-tailed t-test and that of the c; test; 
95% confidence bands for the true power of the c, test are shown. 

Curve t is the power curve of the one-tailed t-test with 6 d.f. such that 6(0) = 
.05. Curve ¢:(R) is the power curve of the ¢,(R) test with N = 8,m = 4,n =4 
at the .057 level, together with the confidence band on the true power of the 
c,(R). 
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COMBINATORIAL PROPERTIES OF GROUP DIVISIBLE INCOMPLETE 
BLOCK DESIGNS 


By R. C. Bose anp W. 8S. Connor! 
University of North Carolina 


1. Summary and introduction. Group divisible incomplete block designs are 
an important subclass of partially balanced designs [1], [2] with two associate 
classes, and they may also be regarded as a special case of intra- and inter-group 
balanced incomplete block designs [3], [4]. They may be defined as follows. 

An incomplete block design with v treatments each replicated r times in b 
blocks of size k is said to be group divisible (GD) if the treatments can be divided 
into m groups, each with n treatments, so that the treatments belonging to the 
same group occur together in \, blocks and treatments belonging to different 
groups occur together in A» blocks. If 4; = Az = A (say), then every pair of 
treatments occurs in \ blocks, and the design becomes a balanced incomplete 
block design, which has been extensively studied [5], [6], [7], [8]. We shall there- 
fore confine ourselves to the case \; * do. 

The object of this paper is to study the combinatorial properties of these 
designs. It is shown that the GD designs can be divided into three exhaustive 
and mutually exclusive classes: 

(a) Singular GD designs characterized by r — \, = 0; 

(b) Semi-regular GD designs characterized by r — \; > 0, rk — vd. = 0; 

(c) Regular GD designs characterized by r — \; > 0, rk — vd, > 0. 

Certain inequality relations between the parameters necessary for the ex- 
istence of the design have been derived in each case. Some other interesting 
theorems about the structure of these designs have also been obtained. Methods 
of constructing GD designs will be given in a separate paper. 


2. Group divisible designs regarded as special cases of partially balanced 
and intra- and inter-group incomplete block designs. A partially balanced design 
with two associate classes is defined as follows. 

(i) There are v treatments, each replicated r times in b blocks of size k. 

(ii) There can be established a relation of association between any two treat- 
ments satisfying the following conditions. (a) Two treatments are either first 
associates or second associates. (b) Each treatment has n, first associates and ng 
second associates. (c) Given any two treatments which are ith associates, the 
number of treatments which is common to the jth associates of the first and kth 
associates of tie second is pj, and is independent of the pair of treatments with 
which we start (i,j,k = 1,2). Also ph = pie. 

(iii) Two treatments which are ith associates occur together in exactly A; 
blocks (¢ = 1, 2). 


1 Now with the National Bureau of Standards, Washington, D. C. 
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It is known [1] that the following relations ho!d among the parameters: 
(2.0) bk = vr, v = m + me + 1, mAL + mde = r(k — 1), 
(2.1) 1+ pu + pi2 = piu + pis = m, 
(2.2) pu + pe = 1+ pn + pe = me, 
(2.3) Mpi2 = NePir, MPs = Nepie. 


If in a GD design with parameters v, b, r, k, A: , Az, m, n, treatments belonging 
to the same group are considered as first associates, and treatments belonging 
to different groups are considered as second associates, then it is easy to see that 
it is a partially balanced design with two associate classes for which 


(2.4) m=n-— 1, Nn = n(m — 1), 


(2.5) pu = i pn = n(m — 1), 


(2.6) Pi = pe =n—1, Pe = n(m — 2). 


Conversely suppose for a partially balanced design piz = 0. Then from 
(2.1), pis = m — 1. The relation of first association between two treatments is 
by definition commutative. We shall show that in the present case it is also 
transitive. Let the treatments 9 and @, be first associates. Let the other first 
associates of 0 be 62, 03, °-- , On,. Now since @ and 6; have m — 1 common 
first associates, they can be no other than @, 62, ---, 8,,. Also since @, has 
exactly m first associates, so all its first associates are 0, 62, 03, °°: , On,- 
This shows that any first associate of 0 (other than 6,) is also a first associate 
of 6,. These conditions are sufficient to insure that the v treatments can be 
divided into groups of nm, + 1 such that two treatments in the same group are 
first associates, and two treatments in different groups are second associates. 
Hence the design is a GD design where the treatments of the same group are 
first associates. Similarly if p’ = 0, we can show that the partially balanced 
design is a GD design, the treatments of the same group being second associates. 
We can therefore state 

THEOREM 1. The necessary and sufficient condition for a partially balanced 
design to be group divisible is the vanishing of pis or piz. If piz = 0 then the 
treatments in the same group are ith associates (t = 1, 2). 

A GD design is also a special case of intra- and inter-group balanced incom- 
plete block designs which have been defined by Nair and Rao [3] in the following 
manner. 

(i) there are v treatments arranged in b blocks of size k. 

(ii) the v treatments fall into m groups consisting of 1; , v2 , --- , Um treatments, 
treatments of the ith group being replicated r; times (¢ = 1, 2, --- , m). 

(iii) every pair of treatments of the 7th group occurs in \;; blocks (¢ = 1, 
2,---, m), and every pair of treatments belonging to the 7th and jth groups, 
t ¥ j, occurs in A,, blocks (7, 7 = 1, 2, --- , m). 
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If in particular 
r=, Ai =A i= 2,-:+,m), 
Aig = Ao (t ¥ j3 14,7 2,---,m), 
then the design reduces to a GD design. ’ 


GD designs may therefore be characterized as the class of designs which are 
partially balanced and intra- and inter-group balanced at the same time. 


3. Relations between the parameters, and the classification of GD designs. 
Clearly 
(3.0) v = mn, bk = vr. 


Any given treatment @ occurs in r blocks. Since each of these blocks contains 
k — 1 other treatments, there are r(k — 1) pairs of which one member is @. 
But @ must form \,; pairs with each of the n — 1 treatments belonging to the 
same group as @, and )¢ pairs with each of the n(m — 1) treatments not in the 
same group as 6. Hence 

(3.1) (n — 1), + n(m — 1)dA2 = r(k — 1). 

Also 


(3.2) = A, r=he. 


The eight parameters v, b, r, k, \y, Ax, m, n are therefore connected by the 
three relations (3.0) and (3.1), so that only five parameters are free. 


Let ni; = 1 or 0 according as the ith treatment does or does not occur in the 
jth block. Then the matrix 


(3.3) N = (nj) 


is defined to be the incidence matrix of the design. From the conditions satisfied 
by the design, it is easy to see that 


(3.4a) ¥ nk =, 


(3.4b) > ni uj = 1 OF Ae, 
j=l 


according as the 7th and uth treatments (i ~ u) do belong or do not belong to the 
same group. 

If in numbering the treatments we follow the convention that the th group 
consists of the treatments number n(l — 1) + 1, n(l — 1) + 2,---, nl, then 
from (3.4) and (3.5) we can write 


A 2 as» 2 


B A -++ B 
(3.5) 


SMAI LOC TIAL TIS ANG ALAR SRLS Ay 





Bint 
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where N’ is the transpose of the matrix N, and A and B are n X n matrices 
defined by 


lr AL eee 1 T As Az “se Ae 
Ai r eee Mi Ae he 4 Ae 
(3.6) mb on = B= 
M1 Mt coe r re Ae ese ea 


Each row or column in the matrix on the right-hand side in (3.5) contains A in 
the diagonal position, and contains B in the other m — 1 positions. 

To evaluate | NN’ | proceed as follows. 

(i) Add the 2nd, --- , mnth rows in | NN’ | to the first row, every element of 
which now becomes r + (n — 1)\y + n(m — 1)d2 = rk (ef. (3.1)). 

(ii) Take rk outside the determinant, and subtract the first row multiplied 
by Az from all other rows. Then 


l l ve bal 


Ar — Ae r—he eee Ay — Ag 
| NN’ | = rk 


A — Ae Ar — Ae es r— re 
r—de Ar — Ae 2 ae ~ — iI 
Ar — Ae r— de $29.¢ Ar — Ae 


}A1 — Az Ar —A2 ses T—Ae 
| 1 1 eo l » 
Ai — Ag 


| 


— 2 --> A—Ae 
= rk {(r — ds) + (wn — 1) — os) 


Ai — A2 Ay — Ae cts) M1 — As 
Using (3.0) and (3.1) we can finally write 
(3.7) | NN’ | = rk(rk — vds)""(r — 1)". 


The quantity rk — vd, occurring above is nonnegative. Here we shall prove 
this statement for the case r — \, > 0, and complete the proof later in Section 4. 
Let N, be the submatrix formed from the matrix N given by (3.3), by taking 
the first 2n rows (which correspond to the treatments of the first two groups). 
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Then 


Yee ee 
(3.8) NiN, -| | 
BA 


(3.9) |NiNi| = {r+ (nm — Id + nro} (F — A)? (rk — vr»). 
Since | N\N; | = 0, it follows that rk — vy = Oif r — A > O. 


Hence we can divide all GD designs into three exhaustive and mutually 
exclusive classes: 

(a) Singular GD designs characterized by r = \, ; 

(b) Semi-regular GD designs characterized by r > \,, rk — vd. = 0; 

(c) Regular GD designs characterized by r > \,, rk — vd2 > O. 

The main combinatorial properties of each of these three classes will be given 
in the succeeding sections. 


4. Singular GD designs. Consider a balanced incomplete block design with 
v* treatments, each replicated r* times in b* blocks of size k*, such that any two 
treatments occur together in \* blocks. Replace each treatment with a group of 
n treatments. Now there are v = nv* treatments divided into v* groups (each 
group corresponding to one of the original treatments). Two treatments belong- 
ing to the same group now occur together r* times and two treatments belonging 
to different groups occur together \* times. We thus get a GD design with 
parameters 


= nv*, nk*, 
(4.0) 

Mi = ”, de = *, 
which belongs to the singular class since r — \, = 0. 

Conversely consider a singular GD design with parameters v, b, r, k, 1, 
Ae, m, n, where r = ),. Let 6 and ¢ be any two treatments belonging to the 
same group. 6 occurs in r blocks, and since r = d,, @ must occur in each of 
these r blocks and nowhere else. Hence if a treatment occurs in a cettain block, 
every treatment belonging to the group occurs in that block. Let each group of 
treatments be replaced by a single treatment in the design, then there are 
v* = m treatments in the new design, and because any two treatments belonging 
to different groups occur together 2 times in the original design, the new design 
is a balanced incomplete block design with parameters 


(4.1) v* = m, r* =f, k* = k/n, A* = de. 


We may therefore state 

THEOREM 2. If in a balanced incomplete block design with parameters v*, b*, 
r*, k*, \* each treatment is replaced by a group of n treatments, we get a singular 
GD design with parameters given by (4.0). Conversely, every singular GD design 
is obtainable in this way from a corresponding balanced incomplete block design. 








web rh re nae: 
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Coro.iary. For a singular GD design b = m. 

For example, consider the balanced incomplete block design with parameters 
v* = b* = 7,r* = k* = 3, \* = 1. The plan for this is given below, the columns 
representing the blocks. 


If n = 2, then we may replace the treatment a by a; , a2, and do the same 
for the other treatments. We then get the singular GD design with the pa- 
rameters 


v = 14, b = 7, r = 3, k = 6, 
Mu = 3, A = 1, m= 7, n = 2, 
the plan for which is shown below. 


aq by C1 ad, é1 fi rep 
a2 be Ce d, e2 fe gJ2 


by CQ d; e hi fi ay, 
be C2 d, 2 f 2 Je a2 
d, e1 fi n a, by C1 


dz e2 fe J2 a2 be Ce 


As before the columns represent the blocks. 

The relation rk — vd, = 0 is true by definition for semi-regular and regular 
GD designs. We shall show that it holds for singular GD designs also. 

Let the parameters of a singular GD design be given by (4.0). Then remember- 
ing the relation \*(v* — 1) = r*(k* — 1) which holds for a balanced incomplete 
block design 


rk — vd, = n(r*k* — v*\*) 
= n(r* — i*) 
2 0. 


Hence we may state 
THEOREM 3. For any GD design rk — v2 2 0. 


5. Semi-regular GD designs. For a semi-regular GD design we have by defi- 
nition 
(5.0) r—r> 0, rk — vr = 0. 
Hence 


(5.1) is oF (n ~~ 1)A\y = nro. 
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We shall now prove the following 
THEOREM 4. For a semi-regular GD design k is divisible by m. If k = cm then 
every block must contain c treatments from every group. 


Let e; treatments from the first group occur in the jth block (j = 1, 2, --- , b). 
Then 


6 
(5.2) > e = nr, 
j=l 
6 
(5.3) ~ ee — 1) = nm — Dm, 
j=l 
since each treatment from the first group occurs in r blocks, and every pair 
of treatments from the first group occurs in ), blocks. Using (5.1), (5.2) and 
(5.3), 


os te 


j= 


Let 


m 
from (3.0). Hence 

b 2 
(5.4) Y¢—-a)’? =n —- = 

j=l m 

= 0 
from (3.0) and (5.0). Therefore 
(5.5) 6 hee ieee OR 
m 

Since e; must be integral, k must be divisible by m. If k = cm then 
e; = c(j = 1,2, --- , b). The same argument applies to treatments of any other 


group. This proves our theorem. 

The relation (3.7) shows that the v X v matrix NN’ given by (3.5) is singular, 
for the case of semi-regular GD designs. We shall now show that its rank is not 
less than v — m + 1. Without changing the rank of NN’ we can transform it 
into M, and then into M; , where 


DD «+++ D 


a ee 
M, = 





a ne 
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where D = A + (m — 1)B, and 


D '' 
SB Ax+Pise@ 

M; = ; 
B . = An 


where 0 is the null » X n matrix. 


If we strike out the last row and column from A — B we get the (n — 1) X 
(n — 1) matrix C given by 


r—d2e Ai — Ao s+ Na — Ae 


Ai — Az r—d)2 +: Ay—Ae 
C = 


Ar — Az Ar — Az ose r— re 





From (5.0) and (5.1) 
|D| = rk(r — )"", |C | = (Ae — A)(r — s)”™. 


If from Mz we strike out the 2nth, --- , mnth rows and columns, then the 
determinant of the resulting matrix is 


| D | |C | m—1 a rk(Xs ad se Vp ee aia aan of 0, 


since \. * Ay and r — A, ¥ 0. Hence 


(5.6) Rank Mz = n + (m — 1)(n — 1) 
=v—m + i. 

But 

(5.7) Rank M, = Rank NN’ S b. 


Hence the following theorem. 

THEOREM 5. For a semi-regular GD design b 2 v — m + 1. 

If the design is resolvable, that is, the blocks can be divided into r groups, of 
b/r blocks each, such that each group of blocks gives a complete replication, then 
(5.8) Rank NN’ = Rank M2 S$ b —r+1, 


since in N the sum of the columns corresponding to a complete replication must 
give a column consisting of unities. Thus not more than b — r + 1 column 
vectors are independent. Hence the following corollary. 

Coro.uary. For a resolvable semi-regular GD design b 2 v — m + 1. 
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6. Regular GD designs. For a regular GD design we have by definition 


(6.0) ‘>, rk — vrs > 0. 
From (3.7),|NN’| > 0. Hence 

(6.1) v = Rank NN’ = Rank N Sb. 
This gives 


THeorEM 6. For a regular GD design b 2 v 

If the design is resolvable then as before Rank N Ss b — r + 1. Hence we can 
state the 

Coro.uary. For a resolvable regular GD design b 2 v + r — 1. 

A GD design is said to be symmetrical if b = v, and in consequence r = k. 
Shrikhande [9] and Chowla and Ryser [10] have obtained conditions necessary 
for the existence of symmetrical balanced incomplete block designs. We shall 
extend their results to symmetrical regular GD designs. With this in view we 
give a brief resume of the important properties of the Hilbert norm residue 
symbol (a, b), , where a and b are rational numbers and p is a prime, and of the 
Minkowski-Hasse invariant [11], [12] C,(A) of a symmetric matrix with rational 
elements. We shall use these symbols in the sense defined by Pall [13]. Detailed 
proofs and a more general theory are available in a book by Jones [14]. 


7. The Hilbert norm residue symbol (a, b), . If a and b are any nonzero ra- 
tional numbers, we define the Hilbert symbol (a, b), to have the value +1 or 
—1 according as the congruence 


(7.0) ax’ + by? = 1(mod p’) 


has or has not for each value r, rational solutions x, and y, . Here p is any prime 
including the conventional prime p, = ~. 

It is clear that the value of (a, b), is unchanged if we replace a and b by their 
square-free parts, that is, if s and ¢ are rational numbers then 


(7.1) (as’, bt’) » = (a, b),. 


Pall [13] has given the following formulae for calculating (a, b), in general, 
where (a | p) is the well known Legendre symbol, and m and m’ are prime to p. 


(7.2) (a, b), = —1, if and only if a and b are negative; 
(7.3) (p°m, p*'m’)» = (—1| p)**(m| p)*' (m' | p)* if p > 2; 
(7.4) (2m, 2°’m’)2 = (2 | m)*'(2| m’)*(— Iyer Por" 

The following properties of (a, b), stated by Pall can be easily verified. 
(7.5) (a, b)p = (b, a)»; 
(7.6) (a,—a)p>=1, (a,a), = (a, —1),; 


(a, bibs)p = (4, bi)p(@, b2)p, (ida, b)p == (a, , b)p(G2, b)y. 





















| 
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For any odd prime p, (a, 6), is evidently +1 unless p actually appears in 
a or b. For a given a, b, (a, b), is —1 for only a finite even number (possibly 


zero) of primes p counting in p, = . This is expressed by writing 
(7.8) IL,(a, b)p = +1. 

8. The Hasse-Minkowski invariant (,(A). Instead of considering invariants 
of quadratic forms f = >> a,;r.2; we might consider the invariants to refer to 
the corresponding symmetric matrices (a;;). 

Let A = (a;;) be any n X n matrix with rational elements. The matrix B 


is said to be rationally congruent to A, written A ~ B, provided there exists a 
nonsingular matrix C with rational elements such that 

(8.0) A = C’BC, 
where C’ is the transpose of C. If D; (¢ = 1, 2,---, n) denotes the leading 
principal minor determinant of order 7 in the matrix A, then if none of the 
D, vanishes, the quantity 


(8.1) G, = CEA) < (+4; DEE i -8 La, 


tal 


is invariant for all matrices rationally congruent to A [11]. 
The invariant C, may be expressed in a more symmetrical form as follows: 


CLA) = (1, —1), D, —D, 1 Di MMi, -D, 


ll 


n—1 
(8.2) (—1, —1),(D:, —1), I] (Din, Dd,(Dian, —)> 


tal 


(—1, —1), Ul (Din, —D,)>p,; 


where Dy = 1. 

If A,_; denotes the matrix obtained by leaving out the last row and column 
of A, we at once get from (8.2) 
(8.3) CoA) = C,(An-1)(Dn , —Da-i)p- 


From this and the properties of the Hilbert symbol we can at once deduce 
the following Lemma, stated by Pall [13] in equivalent form. 
Lemma I. Jf A and B are symmetric matrices with rational elements, and 


A 
(8.35) U= | | 
B 


as the direct sum of A and B, then 


(8.4) C,(U) = (—1, —1),C,(A)C,(B)(| A|,|B 


\)p- 
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Lemma II. Jf A,, is the direct sum of A taken m times, where A is a symmetric 
matrix with rational elements, that is, 


A 
A 
(8.45) ie 
A 
then 
(8.5) C,(An) = {C,(A)} *([A], —DR"*(=1, -—I)37. 


Proor. From Lemma I 
Cy(Ae) = (—1, —1)p { C(A) } (| A|,/A])> 
= (-1, —1)p{ C,(4) } (1 A], -Dp- 
Hence the lemma holds for m = 2. Supposing it to hold for m — 1, we have 
Cy(Am) = Cp(Am+)C(A)(| A} "",| A] )o(—1, —1)p 
(8.6) = C,(An)Cp(A)(| A|, —D> (-1, —D)> 
= {C,(A)}"(|A], -D9"™ (-1, - D5". 


Coro.uary. If d is a rational number and A, is the diagonal matrix of order m 


given by 
d 
d 


(8.65) An = ; 
d 
then 
(8.7) C,(Am) = (—1, —1),(d, —1)9°"7”. 


This follows at once from the main lemma by noting that 
C,(d) = (—1, —-1),(d, —1)> 


when d is regarded as a matrix of order one (cf. (8.2)). 
We shall prove another lemma on a property of the Hilbert symbol which 
we shall use later. 
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Lemma III. For any two rational numbers a # 0, b # 0, and any prime p, 


(8.8) (a, b)p = (—ab,a +b)». 


Let 
' a 0 a+b b 
10 «»b b 6b 


(—1, —1),(a, —1),(ab, —a), = (—1, —1),(a + b, —1),(ab, —a—b),, 


Hence from (8.2) 


or 
(a, —1)p(b, a)p(b, —1)p = (a + b, —1),(ab, —1),(ab, a + b),, 
or 
(a, —1),(a, b),(b, —1)p = (a + b, —ab),(a, —1),(b ,-1),, 
or 


(a, b)p = (—ab,a+ b),. 


Putting a = n+ 1,b = —1 we obtain the following result given as a lemma 
by Bruck and Ryser [15]. 
COROLLARY. 


(8.9) (n+ 1,—-1), = (n+1,n),. 
9. Necessary conditions for the existence of symmetrical regular GD designs. 


Consider a symmetrical regular GD design with parameters », b, r, k, m,n, 1, Az, 
where 


(9.0) y = b = mn, r = k, 
(9.1) (n — 1). + n(m — 1)d2 = r(r — 1), 
(9.2) Q=r-xr>O0, P=r—vdy.>0. 


Since the incidence matrix N given by (3.3) is now a square matrix it follows 
from (3.7) that 


(9.3) | NN’ | = | N ; = eer. 


' hes i 


It follows that P”™"Q™””” must be a perfect square. Hence the theorem 
THEOREM 7. A necessary condition for the existence of a symmetrical regular 
GD design with parameters v, b, r, k, m, n, 1, Az satisfying (9.0), (9.1) and (9.2) 
is that P™"Q™” is a perfect square. 
Let X = NN’ be the matrix given by (3.5), then X is rationally congruent 
to the unit matrix 7. Hence a necessary condition for the design to exist is that 
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C,(X) = C,(NN’) = C,(/) for every prime p. In order to calculate C,(X) we 
shall start by obtaining C,(Y), where Y is the n X n matrix given by 


ri te ta Sie 622 ae 


Ar — Ae r— Xe 70s Ar — Ao 
(9.4) Y = 
Ai — Ae Ai — Ae *<¢s r— he 
Referring to the derivation of (3.7) it is readily seen that |Y¥| = PQ"”. 


Let us set 


where X = A; — Ao. 
Hence from (8.3), 
C,(¥1) = C,(Y)(—vAPQ"", —PQ""), 
(9.45) f i 
= C,(Y)(—A, —1)p(—A, P)p(—A, Q) 37. 
If we add the last row in Y, to each of the other rows, and then the last column 
to each of the other columns, we get 


r—--d 0 eee 0 —r 
0 r—h ¢ 0 —r 
Yi~ ¥2 = 

0 0 r—dm —A 

—) —A «++ =—h =A 
Since | ¥2| = | Yi! = —APQ"” it follows from (8.3) and (8.7) that 
C,(¥1) = C,(¥2) = (—1, —1),(Q, —1)3°"*”""(—APQ"", —Q"), 

(9.5) = (—1, —1),(Q, —1)3°*'"(—-a, —1),(—A, Q)5 


‘(P, —1)(P, Q)5(Q, —1)5°. 
Comparing (9.45) and (9.5) we finally get 
(9.6) C,(¥) = (-1, -1,(Q, -—13°""(P, (Q, »)AP, Q)>, 


where AX = A; — Ao. 
To calculate C,(X) = C,(NN’) we now proceed as follows. Set 
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From (8.3) and (9.3), 
C,(X1) = C,(X)(—erP*™"Q", —°P™'Q"”), 
= (,(X)(—re, —1),, 
since from Theorem 7 P” “Q”™"” is a perfect square. 
Again we may transform X, to the rationally congruent matrix X; , by adding 


the last row of X, to each of the other rows, and then the last column of X, to 


each of the other columns. Thus 
Y L | 
r L 


' & 
L’ L’ "ie? i —)e 


(9.65) 


where Y is given by (9.4), Lris an » X 1 column matrix with each element as 
—-: and L’ is the transpose of L. We note that 


| Xa] = | Xa] = —rar’Prgne, 
Hence from (8.3) and (8.5), 
C(X1) = Cp(X2) = {C,(¥)}"(PQ"™*, —1)5°""(-1, — 1)" 
‘ le 
rr = {C,(Y)}"(PQ"", —1)3"” (-1, —D5(—&, —Do(—e, Po, 


since P™"Q™"”” is a perfect square. 
Comparing (9.65) and (9.7) 


C,(X) = C,(NN’) = {C,(Y)}"(PQ™", —1)3°"?7(-1, —IP"(—r, P)>- 
Substituting from (9.6), 


C(NN') = (—1, —1)9(Q, — DR PAP, — 15°" 


(9.8) . a 
-(PQ, 1 — A2)'5(P, Q)"(P, —Az)p - 
Now 
(P. —1)3 (P, = an (P, P™”),(P, oH. 
(9.85) = 


reer. 
+1. 


Also from (9.1) 
n(ry — 2) = P— Q. 
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Therefore, 
(PQ, Ar — Az)p = (PQ, P — Q)p(PQ, 2)» 
(P, —Q)2(P, n)(Q, 2)» 
from (8.8), whence 
(PQ, is — A2)p = (P, —1)9(P, Q)o(P, 0) 0(Q, 1p - 
Hence finally 
C,(NN’) = (—1, —1)9(Q, —1) 3 OP, — I)" 


. FF, n)'3(Q, n)5(P, de)p ° 


(9.9) 


We thus get 

THEOREM 8. A necessary condition for the existence of a symmetrical regular GD 
design with parameters v, b, r, k, m,n, A1, 2 satisfying (9.0), (9.1) and (9.2) ts that 
C,(NN’), given by (9.9), is equal to C,(I) for all primes p, where I is the unit 
matrix. 

Note that from (7.2), (7.4), (7.6) and (8.2), 
(0.35) C,(1) = (-1, -1)p 1 if p = 2or po, 

+1 if p is an odd prime. 


Confining ourselves only to the case when p is an odd prime, we can combine 
Theorems 7 and 8 into the following single theorem. 

THEOREM 9. If a symmetrical regular GD design with parameters v, b, r, k, m,n, 
Ai, Ae satisfying (9.0), (9.1) and (9.2) exists then 

(a) if m is even P must be a perfect square and if further m = 4t + 2 and n is 
even (Q, —1)» = +1 for all odd primes p; 

(b) if m is odd and n is even Q is a perfect square, and ((—1)*nd2, P)p = +1 
for all odd primes p, where a = m(m — 1)/2; 

(c) if m and n are both odd ((—1)*nd2, P),((—1)*n, Q)» = +1 for all odd 
primes p, where a = m(m —1)/2 and B = n(n — 1)/2. 

PRoor. 

(a) If m is even then in P™ 'Q™””” the index of Q is even and the index of 
P is odd. Hence from Theorem 7, P must be a perfect square. Noting that 
(—1, —1), = +1 for all odd primes p, C,(NN’) reduces to 


(n—1) (m+n—1)/2 
i - - 


If now m is of the form 4t + 2 and n is even, then the index of (Q, —1), is odd. 
Theorem 8 shows that (Q, — 1), = + 1. 

(b) If m is odd and n is even then in P™“Q™””” the index of P is even and 
the index of Q is odd. Hence from Theorem 7, Q is a perfect square. AlsoC,(NN’) 
reduces to ((—1)°ndz , P), for all odd primes p, if a|= m(m — 1)/2. The result 
follows from Theorem 8. 








382 R. C. BOSE AND W. S. CONNOR 


(c) The result follows from Theorem 8 by noting that if m and n are both 
odd then for all odd primes p 


Cy(NN’) = (nr2, P)p(n, Q)p ifm = 4¢+ 1, n=4t+1; 
= (—nr2, P),(n, Q)p ifm = 4t + 3, n= 4t+1; 
= (nr, P),(—n, Q)» ifm = 44+ 1, n= 4t+ 3; 
= (—nhr2, P)p(—n, Q)p ifm = 4t + 3, n= 4t+ 3. 


We give below a table of some symmetrical regular GD designs whose im- 
possibility can be proved by using Theorem 9. The last column gives the reason 
for impossibility. Thus for the design “Ref. no. 1,”’ the statement P = 5, Th. 
9(a) in the last column means that P = 5 contradicts Theorem 9(a). Hence the 
design is impossible. 


Some impossible symmetrical regular GD designs 
Ref. no. vb r=k m oe Be NS Reason for impossibility 


| 


] 44 7 22 ze 7 P = 5, Th. 9a) 

2 92 10 46 20 1 P = 8, Th. 9(a) 

3 a 828 22 1 P=8, Th. 9(a) 

t 88 10 22 472 1 P = 12, Th. 9(a) 

5 a § 0 2 3 3 P = 5, Th. 9(a) 

6 w ¢ 2 Fees P = 13, Th. 9(a) 

7 30 «9 2 16 3 2 P = 21, Th. 9(a) 

8 22 511 2041 £Q=5, Th.9%b) 

9 wo PF BW. a 4 Q = 5, Th. 9(b) 

0 90 10 45 22 1 4#Q=8, Th. 9b) 

11 30 8 15 202 Q=8, Th. 9b) 

12 33 6 ll » oO } (—nd2, P)3(—n, Q)3 = —1, Th. 9(e) 
13 93 10 31 i ae (—ndrz , P)s(—n, Q)s = —1, Th. 9(c) 
14 95 10 19 5 @ I (—nr2, P)s(n,Q)s = —1, Th. 9(c) 
15 ms Ff HK Fs 3 (ne, P)s(—n, Q)s = —1, Th. 9(c) 
16 = + 3 #2 3% (—ndr2, P)u(n, Qu = —1, Th. 9(c) 
17 2. Fa 2 3.1 (—nr2, P)3(—n, Q)3 = —1, Th. 9(c) 
18 oS @° 28 8 3 2 (nro , P)s(n, Q)s = —1, Th. 9c) 
19 i “66 S93 2 (nr\2, P)3(—n, Q)3 == —1, Th. 9(c) 
20 a 9 TF 63 2 (—nr2, P)s(n, Q)3 == —1, Th. 9(e) 
21 so (10 ii 30 3 (—ndrz2, P)s(—n, Q)s = —1, Th. 9(c) 
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THE OPERATING CHARACTERISTIC OF THE CONTROL CHART FOR 
SAMPLE MEANS! 


By Epagar P. Kine 
Carnegie Institute of Technology? 


1. Summary. In this paper we derive the operating characteristic of the con- 
trol chart for sample means when process standards are unspecified. Under the 
null hypothesis the distribution of the process is N(u, 0°), where u and o are 
fixed but unknown. Under the alternative the process mean is a random variable 
with a N(y, 60°) distribution. Exact results are obtained for cases ranging from 
two samples of size 2 to four samples of 10. Bounds on the operating character- 
istic are obtained in particular cases ranging from five samples of 5 to 25 sam- 
ples of 10. 

2. Introduction. The usual procedure in constructing control charts from 
past data consists of the following steps [1]. 

(a) Classify the total number, N say, of observations to be drawn from the 
process into m samples of size n according to some rational method of sub- 
grouping. 

(b) For each sample, calculate a mean and a range, plotting these values on 
separate charts in the order drawn. 

(c) Using prescribed formulae based on the data collected and the sample 
size, calculate upper and lower control limits for each chart. 

(d) If all the plotted points fall within the control limits on both charts, 
accept the hypothesis that the process is in a state of statistical control. Other- 
wise, reject this hypothesis. 

In what follows we shall confine our attention to the control chart for means. 
Letting x;; denote the jth observation in the ith random sample of size n, we 
will be concerned with the following linear model 


Xij = wi t+ G;, ¢m 1,2, ---,m7 = 1,2, --- ,n, 

where 

(1) the ¢;; are statistically independent and distributed according to N (0, 0°); 

(2) the yu; are statistically independent and distributed according to N(u, &o°); 

(3) the yu; are statistically independent of the ¢;; ; 

(4) » and o are fixed but unknown. 

Let #; and r; denote the mean and range, respectively, of the 7th sample 
Xiu, °***, Xin. The usual control chart procedure prescribes that the limits on 
the #-chart be set at J + A.?, where 


t=-— dw, f=i dn, 


MN jul il M iwel 





1 Submitted in partial fulfillment of the requirements for the D.Sc. degree at Carnegie 
Institute of Technology. 


* Now at Statistical Engineering Laboratory, National Bureau of Standards, Washing- 
ton, D. C. 
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and A, is defined by E(As?) = 30/+/n when the underlying distribution is nor- 
mal. What we seek then is the probability that the inequalities 


X— A < % <%= + A), t= 1,2, ---,m, 
be satisfied simultaneously. Defining 
(2.1) B(k) = P(-fass <ii—-Z < fAde, tee ,— 5 AF < im —2 < * As?) 
we wish to evaluate 8(3) under the hypotheses 
Hy: @ = 0; 
H,:6@>0. 


The null hypothesis, Ho , is the hypothesis of statistical control. Our choice of 
the alternative @ > 0 is motivated by practical considerations. Since shifts in 
the mean of an industrial process might occur at any time and be of any mag- 
nitude, an alternative which ordered the u; in a particular way would be of 
limited interest. By treating the u; as random variables we are taking into 
account the “average effect”? of m independent assignable causes of varying 
magnitude. Although we are unable to specify the size of any particular shift, a 
measure of the size of the yu; as a group is given by the parameter 0. 


3. Taylor’s series expansion of $(3). The general method employed in cal- 
culating 8(3) is first to obtain 


Bok) = P(-k <a 2 <k ip, eos - kT < tm -B <b) 
Z, — = im — £ 
= P(-8< Be < ky bk Be <r) 


as a function of k for fixed m. We note that 8(k) is of considerable interest in 
its own right, since (3) represents the probability that the Z-chart will show 
control when ¢ is known. 

To evaluate 8(3) we multiply the conditional probability that (for fixed 7) 
—Af < ; — % < Ao (i = 1, 2, --- , m) by the pdf of 7 and integrate on 7 
from 0 to «. For fixed 7 we have 


(3.1) 











P(—Az? <a — % < Aof, +: ) 


Ag “4-2 . A# Vn Arf 
-P(- o/Vn ~o/Vn ~ ova o)= oo ( o ). 
Let gmn(7; 7) denote the pdf of the average range of m h a samples of n 
from a N(y, o’) universe. Then 


(3) = | gnn(w; o)6e (vn As 4 a 
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Letting gmn(w; 1) = gmn(w), we have 


l w 
Jmn(W; a) _ o Ymn ‘ ) . 
@ 1 . = w 
B(3) = [ Jmn (*) Bo (vin Ae _ dw. 
0 ¢ o o 


Finally, letting 7 = w/o yields 


Thus 


(3.2) (3) - | Jmn(F)Bo(>/nAeF) dF. 
0 


We now expand 8)(+/n As?) in a Taylor’s series with remainder about the point 
7 = dy, where doo denotes the expected value of the range in a random sample 
of n from a N(p, o°) population. Clearly 


(3.3) Bola/nAoF) = Bo(3) + bi(F — do) +--+ + 2 (# — d.)? + R'(é), 


where the b; are the ith derivatives of Bo(+/n As?) with respect to 7, evaluated 
at 7 = ds, and 


ty b i(&) it \ p+1 i. 
(3.4) R(é) = =~ (F — ly)’ ’ = dy ; = dz), 0 = : 
g ip + 1)! ¢ g + a( a 


This expansion is valid since all the b; are continuous. Now, taking the expecta- 
tion of both sides of (3.3) yields 


IA 


I Qmn(F)Bo(A/nAot) dF = ao(3) | Ymn(F) dF 
0 0 


+ db; [ (F — de)Gmn(F) dF + +++ + [ R'(E) gmn(?) dF 
0 0 


But since the first integral on the right side is unity and the second zero, we have 


where the u,(7) are central moments of average range, and 
, ( ara 
(3.6) R= [ Does “  F — ds)? gmnlF) af. 
o (p+ 
For the actual numerical mae of 6(3), relation (3.5) is used in the form 


(3.7) 6(3) = Bo(3) + = wt + : et +35 [us(r) + 3(m — 1ya(r)] + - 





where the u;(r) are the 7th central moments of the range in samples of n from a 
N(u, 1) population. In each case, a sufficient number of terms of (3.7) is used 
to insure that the remainder, R, is small. 
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4. Derivation of §.(k). As indicated in the previous section, our first task is 
to obtain an expression for 6(k). It is apparent that it can be written as 


E(m) — 4 Ps i — fy 
(4.1) k) = P = FF < k) 
Bo( ) o/Vn n ’ 

where Z,m) and Z,) are the largest and smallest sample means, respectively. To 
obtain a tractable expression for — —— we shall first investigate the 

E(m) — i 
joint distribution of —— and - >= . For this purpose let us consider 

o/V/n ae purp 
the joint pdf of the ordered variates Za) < Fe) < -++ < Fm) . Since #; = yi + &i, 
where @; = >>}. €:;/n, we see that the distribution of #, is normal with mean yu 
and variance (@° + 1/n)o’. Assuming » = 0 (with no loss of ee we have 

m! 


S(Eay , +++ , Eqm) = earn (LEY (s exp| a = nb? woe 


as the joint pdf of Za) < Ze) < +++ < Fim). To obtain the joint distribution of 
Em) — 2 i2 t— Zw 
— and , let 
a/V/n ‘o/V/n’ 


a . 
Va V2% = —fw + Fa, 


Cc eet 
wa V/3-2 2 = —Z£ 2) —Zsx) + 2, 


Gg setae taints 
Jn V(m — 3)(m — 2) Um-s 


—F2) — Fis) — +++ —Fqm—2) + (m — 3) Fem», 


Mm — Nm — 2 
Vn Vv (m = )(m — ) Um—2 


—(m — 2)¥a) + Ee) + +++ + Fem, 
oC jaiepequeepmemmetamaste a - - . 
Vn V/m(m — 1) ma = —#a) —Fa) — +++ —Fqm_y + (m — 1) Fem, 


a 
vy Vm im = Fay + Fay + +++ + Fema + Em- 


This transformation gives 


m! a 
(v eee ) = nr exp al vY 
g\Y1, rm (On + no?y? P| 201 + no’) & 


as the joint pdf of the v; , defined over the region S given by 
be > 0, 7. < 4f ES ous, (i = 1,---,m— 4), 


- /m(m — 2) Uma > V/(m — 1)(m — 3) Ums + Um-2, 





4/2 << r. V2 Um-3 
m—2” >t W327 um —/(m — 2)(m — 3)° 


AAA ALAN AAT OCE 


eae 


ee 


ST TE Se SESE ee Wen oon 


is 
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Now, we integrate out v,, and let 
Y= U4, (i = 1,--+,m — 3), 


—peemepgennnana 3 
V(m — 1)(m — 2) m—2 


y os m 
re a ae 


where in terms of the original variables 


oe Lim) — F 
iF ~ o/Vn ? 


Vn—2 = — 














(4.2) a ma 
Zt — Ia) 
|v = a & 
U  a/Vn 
The Jacobian of this transformation is | J | = +~/m/(m — 2). The joint density 
Of 1, U2, °** , Um—z, U, v is finally obtained as 
! 
Pm (Uy coe tn~35 tt, v) = a ee 
(4.3) , ? (2x Pe + ne? ) (m—1) 12 
. = ie 
“eNP LL 211 + 6") ; nd) 2 “| P| — oc + nat 


over S’, where 








m— | 2 2 o 
A = = ) 
m 7 (u + v ) ; = UW, 





us >0,u>0,0> 0, < 4/ A? was, (i = 1,---,m— 4), 
S’ is< tH Us Um—s 1 

— “ee A eo — |] a ’ 
Vat 7320+ + Vi — am — 8) Sm — 2 — eal 
V(m — 2)(m — 3) Uma < (m — 1)u — ». 


For the cases m = 2 through m = 4, 8o(k) is obtained by integrating (4.3) over 
the range uw, -*- , Um3 € S’, u < ki v < k. B(3) is then evaluated from the 
series (3.7). For cases where m > 4, bounds on the desired probabilities are ob- 
tained by methods described in Section 5D. 


5. Exact evaluation of $o(k) and 6(3). 
A. Case m = 2. In this case, 8o(k) becomes simply 


p(-#< 3 <2) 
(a) - o(- a) 





Bo(k) 
(5.1) 
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#* dt. The series expansion for 8(3) becomes 


1 z 
wnere ®(z) = Von [ e€ 
T 2 


(5.2) (3) = Bo(3) +? > yo(r) +o Mal) +; 95 (mal) + 3u3(r)) + - 


where 


b -(4 Bon As) | 


The moments u;(r) are obtained from Hartley and Pearson [2]. Expression (5.2) 
is used to evaluate 8(3) for n = 5 and n = 10. For the sake of completeness 
the case n = 2 is also included. In this case, the pdf of the range is 


h(r) = a eve (r > 0). 


To 


Hence, by the standard convolution (see [4], p. 191), 


gul(¥; 0) = 2 [ ” A(oF — ) h(t) dt, 


which reduces to 


9u(?; ¢) = Ta’ Fe) l* ( 


Hence 


B(3) = [ G2a(F)Bo(+/2A2F) dF 
oo 4 - 
= | FRM - 2-7) 


|» (View) -°(- view)| 


1 — (3) is then evaluated by numerical integration. 

The results for m = 2 are summarized in Tables I and II below. 

B. Case m = 3. We find from (4.3) that the joint density of u and v is given by 
at eae bas 3! /3 | 1 e 2 | , 
(5.3) fs(u,v) = Oe + nb) exp a0 + ne) (u uv+uv)]| over S, 


where 


- J0<9< Bu 
, ’ 
s Meccan 


Bolk) = 2 [ i. | falu, v)do, 





390 EDGAR P. KING 


by virtue of the fact that f;(u, v) is symmetric about the line u = v. This inte- 
gral reduces to 


3 k | (24/14+n62) ‘ 
(5.4) folk) = 6 i | PA) dt, 
TT 0 


where F;(x) is defined by 
9 z 
F(x) = = | e- 
(a) = = | 


F(x) is the edf of the extreme deviation from the sample mean in samples of n 
from a N(0, 1) population. This function has been tabulated by Grubbs [3]. 30(3) 




















TABLE I TABLE II 
Bo(3) for m = 2 B(3) form = 2 
8 n=2 | n=5 | n=10 ae | n=5 | n= 10 
| 

0 | 1.00 | 1.00 | 1.00 0 = .96 | 1.00 | 1.00 
5 1.00 | 1.00 .98 S| 021 2 .96 
1.0 99 | 92 80 1.0 | .89 ‘39 | 79 
1.5 93 | .77 62 1.5 .82 | 75 | .61 
2.0 84 | .64 | .49 2.0 75 63 | 49 
i 2.5 | .75 .00 .40 2.5 .67 4 | .40 
: 3.0 | .67 A7 34 3.0 61 46 | .34 

: ; & | 

‘ is evaluated from (5.4) by numerical integration and 8(3) obtained from the 
; series (3.7). The results for this case are summarized in Tables III and IV. 


C. Case m = 4. From (4.3) we obtain the joint pdf of wm , u, and v as 


“ V3 
a 2 —[u3/(2(14n62)))] —[A4g/ (201462) 
————e @ 1 e 


(5.6) haus, u,v) = —— over S, 
(2r)*(1 + ne’)*” 
where 
Ay = 36(w + 0”) — w, 
(uy >0,u>0,v> 0, 
S isi V2 u, < 3v — 4, 
\V2 um < 3u — »v. 


To obtain f,(u, v), the joint density of u and v, we integrate over the range of 
u, , With the following result 


2))] (3v—u)/4/2 t 2 ‘ 

—[A4/(2(1+n6?)) ~ 2(14+n62))] 

1“ - I ger du, 
0 





for v <u < 32, 
filu, v) = 


(3u—v)/+/2 ‘ . 

—[A,/(201 6?)) -_ 2(1+n62)) 

vedere ‘| e G0 ay = for u <u < 3u, 
0 


poe 
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4s / 
Cy 2 


where 


(3v—u) / 4/2 a ‘ 5 (3v—u) / (24/1+n62) . 
[ en (2(14+62)) du ion V/2 ‘ /} + net [ e* dt 
0 0 


ial 3u — u ) 
V1i+ nth Fs (5p 
TABLE III 


TABLE IV 
Bo(3) Sor m=; 


8(3) form = 3 
n=2 | n=65§ 


1.00 | 
.99 


| 
} 
| 
_92 
.74 
.56 
42 
Dy cbs to th 


32 


In exactly the same manner 


(au) V/2 PU (2(1+n62))] du —v 
I du, 5 v1 + n@ F, (=): 


Therefore 


fi(u, v) = C1 /* VI + nb € elaaeenl G (u, v), 


3u —v 
| Fs (as 7 5) for u<o< du, 
G(u, v) = 


3u — u 
|p. (=) for v<u < 3v. 


Bok) = of auf filu, v), du, 








aA ee mr REte 


Ane aH 
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since f,(u, v) is symmetric in u and v. After some reduction we find 





4 

te aoe 3 2k | (84/1+n02) edi 

(5.7) Bo(k) = 12 e F;(t) dt, 
0 


V 20 


where 


> t 
F,(t) = ee / go Pp, (2) dz. 
~ T 


As before, 8o(k) is evaluated by integrating (5.7) numerically and (3) is ob- 


tained from the series expansion. The results for this case are summarized in 
Tables V and VI. 





TABLE V TABLE VI 
Bo(3) for m = 4 B(3) form = 4 

6 n=2 n=5 n= 10 0 n=5 n= 10 
0 1.00 1.00 1.00 0 .99 1.00 
5 98 91 76 5 . 87 74 
1.0 .82 .52 27 1.0 51 27 
1.5 56 .25 ll 1.5 - 26 11 
2.0 .34 12 05 2.0 .13 -05 
2.5 22 .07 .03 2.5 .07 .03 
3.0 14 .05 .02 3.0 05 .02 


D. Case m > 4. In this section we derive upper and lower bounds for {(k) 
and 6(3). Recalling that 6o(k) = P(u < k, v < k) we immediately obtain the 
upper bound {(k) S P(u < k). But since u = (cm) — £)/(¢/-/n), we see that 
u/V1 + né@ is distributed as the extreme deviation from the sample mean in 
samples of m from a N(0, 1) population. Hence, using Grubbs’ notation [3] 


k 
(5.8) Blk) S Fr (as): 


It follows that 


: o - 2 ” - a - oe _. /n Ar) s 
(5.9) (3) -[ Gmn(F)Bo(/n As?) ars [ Jmn(F) Pm (2285 . 


(5.9) is then expanded in a Taylor’s series with remainder by the method of 
Section 3. 

To obtain a lower bound, we have from elementary probability considerations 
Ptu<korv <k) = Plu<k)+ Pv < k) — Plu < k,v < k), or 


(5.10) Plu< kv <k) = Plu< k) + Pv < k) — Plu < korv < k). 








OPERATING CHARACTERISTIC OF CONTROL CHART 


Since the last term in (5.10) cannot exceed unity we have 
P(u < k,v < k) = B(k) = Ptu<k) + Pw <k)- 1. 
But 


k 
P(u < k) = Pv < k) = F, (soos): 
TABLE VII 
Bounds on B)(3) 


Therefore 


k 
(5.11) Bo(k) = 2Fn (T=) — 1. 


The corresponding lower bound on 8(3) becomes 


a/n AcF 


(5.12) 8(3) = I Gmn(F) | 2. (yar 





{ 
; 
: 
q 


eae 


394 EDGAR P. KING 


which is again evaluated by a Taylor expansion. The results given in Tables VII 
and VIII do not include certain intermediate values of 6 in the range 0.25 to 
1.50 because the lower bounds (5.11) and (5.12) are very weak in this range. 


TABLE VIII 
Bounds on (3) 


m = 10 


n=5 


.99 


00 .06 
00 .O1 
































.00 





An important feature of Tables VII and VIII is the close agreement between 
corresponding values of 8(3) and 8(3). Our ignorance of ¢ is of little consequence 
so far as these results are concerned. 


6. Bounds on the remainder term. In each of the Taylor expansions used in 
Section 5, there is a remainder term of the form 


pore 


Jmn(F) dF. 
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In order to determine a bound on R, we note that 


Ric f Lon @®l i. _ 2 we (9 ap 
Ris [Gt alan at 
Max | bei(€) | [" 15 _ 4 jot 
=—-@TD! fl ~ 


If we restrict p to be an odd integer, we have 
Max | bp4:(€) | 
(p + 1)! 
In practically all cases given in the preceding tables, a sufficient number of 
terms of the series (3.7) is used to insure that the bound (6.1) does not exceed 


0.005. In isolated instances where this is not possible, terms up to and including 
be/6! we(i') are employed. 


Jmn(7) dF. 


(6.1) \R|s Mp+1(?). 
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THE USE OF PREVIOUS EXPERIENCE IN REACHING 
STATISTICAL DECISIONS! 


By J. L. Hopes, Jr., anp E. L. LEHMANN 


University of California, Berkeley, and University of Chicago and Stanford 
University 


1. Summary. Instead of minimizing the maximum risk it is proposed to re- 
strict attention to decision procedures whose maximum risk does not exceed 
the minimax risk by more than a given amount. Subject to this restriction one 
may wish to minimize the average risk with respect to some guessed a priori 
distribution suggested by previous experience. It is shown how Wald’s minimax 
theory can be modified to yield analogous results concerning such restricted 
Bayes solutions. A number of examples are discussed, and some extensions of 
the above criterion are briefly considered. 

2. Introduction. Among various possible approaches to the problem of de- 
fining a best decision procedure we may mention the following two extremes. 


(i) The Bayes solution. If the unknown parameter @ is a random variable 
distributed according to a known probability distribution \, and if R;(@) denotes 
the risk function of the decision procedure 6, we simply minimize with respect 


to 6 the average risk / R;(0) dd(8). 


(ii) The minimax principle. Here one focuses attention on the maximum of 
the risk function and wishes to minimize supe R;(@). The reader may consult 
Wald [1] for definitions and examples of these terms. 

Of these two methods of treating the problem the first one assumes complete 
knowledge of the a priori distribution, an assumption that is usually not satisfied 
in practice. Even if extensive past experience is available, it will in most cases be 
difficult to exclude the possibility of some change in conditions. On the other 
hand, the minimax principle forces us to act as if @ were following a particular 
a priori distribution, the one least favorable to us, even though we may feel 
pretty sure that actually 6 is distributed in quite a different manner. Thus it 
would seem that the minimax principle is suitable, if at all, only in situations 
characterized by a complete absence of past experience or other sources of 
knowledge concerning @. 

The situations occurring in practice usually lie between the two extremes just 
described. On the one hand, one does frequently have a good idea as to the 
range of 6, and as to which values in this range are more or less likely. On the 
other hand, such information cannot be expected to be either sufficiently precise 
or sufficiently reliable to justify complete trust in the Bayes approach. 

The purpose of the present paper is to discuss an approach to the problem of 


1 Work sponsored in part by the Office of Naval Research. 
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optimal decisions that utilizes the available information but at the same time 
provides a safeguard in case this information is not correct. 

Suppose that the maximum risk of the minimax procedure is C. This is the 
smallest possible value for the maximum of a risk function. But we may be 
willing to tolerate a somewhat bigger maximum risk Cy > C if, in case the guess 
at \ has been a good one, there results a substantial decrease in the average risk. 
This leads to the 

Derinition. The procedure 4p is said to be a restricted Bayes solution with re- 
spect to the a priori distribution \ and subject to the restriction 


(2.1) R(@) S Co for all 6, 


if it minimizes / R;(0) d\(@) among all procedures satisfying (2.1). 


This definition takes into account two aspects of the risk function, its su- 
premum and its average with result to the distribution \. Within a certain range 
of values each of these can be improved at the expense of the other. The proper 
balance between the two, that is, the value we select for Cy, depends on the 
confidence we have in 6’s actually following a distribution close to \ and on the 


decrease in / R; dd that can be achieved by further increasing C) . 


To the above approach can also be given the following slightly different form. 


Instead of setting an upper bound for the risk, we specify a constant 0 S po S 1 
and minimize 


(22) po | Rs @) arto) + (1 — po) sup Rs (0). 


Here it is po that indicates the confidence we have in \. The two principles are 
clearly equivalent; for if 5) minimizes (2.2) and if sup R;,(@) = Co, then 4 is a 
restricted Bayes solution, and the converse also holds. 

The formulations given here may be applicable also to games played against 
an opponent rather than against Nature. This would be the case if one believed 
from past experience that the opponent is likely to make certain mistakes. 
One could then take advantage of these and still protect oneself in case the 
opponent has improved. 


3. Restricted Bayes solutions. The principal aim of the present section is to 
obtain sufficient conditions for a decision procedure to be a restricted Bayes 
solution. For this purpose the modified problem mentioned at the end of the last 
section turns out to be the more natural one to consider; the results concerning 
restricted Bayes solutions follow as immediate corollaries. All of the theorems 
of this section will be simple generalizations of the corresponding results in 
Wald’s minimax theory. 


THEOREM 1. Let v be a distribution for which there exists a constant 0 < po S 1 


‘ 
’ 
4 
: 
: 
: 
t 
? 
t 
: 
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and a distribution po such that 


(3.1) Y% = por + (1 — po)mo. 
Then if the Bayes solution 5 of vo satisfies 


(3.2) J Rs, @ duo) = sup Rs, (0), 


the procedure 5) minimizes 


(3.3) a / Ry (0) dd(0) + (1 — po) sup Rs (0). 


Proor. Let 6 be any procedure. Then 


po | Reds + (1 — po) sup R; (0) 2 wm [ Rant (1 = ps) | Rs du 


> mf By dd + (1 — px) [ Ray duo = oo [ Ray dd + (1 — ) sup Ra, (6). 


Coro.uary. Under the assumptions of Theorem 1 suppose that sup R;,(@) = Co. 
Then 69 minimizes / R; d\ among all procedures satisfying R;(@) S Co for all 0. 


Since a distribution v) with the required properties does not always exist, we 
state the following generalization of Theorem 1. Jf v; is a sequence of a priori 


distributions with v; = po + (1 — po)ui, and if 6; are the associated Bayes solu- 
tions, then 


(3.4) lim [ R.. du; = sup R,, (0) 


is a sufficient condition for 5) to minimize (3.3). 

Before proceeding with this development let us discuss briefly the decomposi- 
tion (3.1). For a given pair of distributions \, v consider the totality of numbers 
0 < p S 1 such that v = pX + (1 — p)u for some ux. It is easily seen that this 
set is a closed interval 0 S p S p,, and we shall call p, the A-component of v. 
It is of interest to note that under the conditions of Theorem 1 we have po = py 
unless Cy is the minimax risk. For if pp is not the \-component of it follows 
that ~o must have a positive \-component. Thus any point of increase of X is 


also one of uo and we have [R, dx = Cy. But by Theorem 1 this is possible 
only if Co is the minimax risk. 

As in the minimax theory the distribution » of Theorem 1 is “‘least favorable’’ 
for the statistician, in a sense made precise in 

THEOREM 2. Under the assumptions of Theorem 1, the distribution vo maximizes 


the Bayes risk among all a priori distributions v that permit a representation 


v= pr + (1 — p)uwithp = po. 
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Proor. Let v = p\ + (1 — p)u be any distribution with p = p) . Then 


[ Re, a>, = oo [ Rs, dd + (1 — po) sup Ray (0) = vf Ry dr 
+ (1 — p) sup Ry, (6) = p | Rud + (1 —») | Rs du 


= [ Rs, @ ao. 


Thus do is a maximum solution for Nature (in Wald’s interpretation of a decision 
problem as a two-person zero sum game whose players are Nature and the 
statistician), if she is restricted to a priori distributions whose \-component is at 
least po . : 

From the proof of Theorem 2 it is seen that vp not only maximizes the Bayes 
risk but also—and this is a slightly stronger result—the restricted Bayes risk, 


that is, the quantity inf / R; dd when 6 is restricted by the condition R;(@) < Co 


for all 0. 

In Theorem 1 we gave sufficient conditions for a procedure 4) to be a restricted 
Bayes solution, and the distribution ») in terms of which these conditions were 
formulated was further characterized in Theorem 2. We must still prove the 
existence of a distribution with the desired properties, at least for some class 
of decision problems. This is easily done, along the lines of Wald’s proof of 
Theorem 3.10 of [1], under the following assumptions. 

ASSUMPTION I. 


inf sup | po [Ra dn +(1— oo) | Rs au 


= sup inf | fw dy + (1 — po) [R dn. 


This states that the decision problem is strictly determined when Nature is 
restricted to distributions with A-components 2 po. 

ASSUMPTION 2. There exists a least favorable distribution yo , that is a distribution 
that maximizes 


inf BE dy + (1 — po) [R an |. 


AssuMPTION 3. There exists a decision procedure 59 that minimizes 


sup | mf Re dy + (1 — po) [x au |. 


It follows from Wald’s work that 1 and 3 hold, for example, when Conditions 
3.1-3.6 of [1] are satisfied, while in general 2 requires the stronger Condition 
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(3.7). All these conditions are satisfied, for example, when we are dealing with 
discrete or absolutely continuous distributions, the problem is nonsequential, 
the loss function is bounded and the parameter space is compact. 

To prove our result, we note that 


sup | o» [Ra dd + (1 — om) f Radu] =o f Riad + (1 — o») sup Ri). 


Therefore, we have by assumption 


pv | Ra dd + (1 — o) sup Ri (@) = inf BE a+ (1 — pw) [ Rs awe, 


and hence 


po | Rs, ad + (1 — po) sup R,,(6) = po | Ray ad +(i- px) | Bay duo. 


But this implies, when pp) < 1, that 
sup Rs, (6) = [ R., duo . 
On the other hand, the result is true vacuously when pp = 1. 


4. A continuity theorem. We shall next consider the dependence of the re- 
stricted Bayes solution on the restricting quantity Cy. The main result will be 
a continuity theorem that permits us, at least in some cases, to characterize the 
topological structure of the restricted Bayes solutions. 

Throughout this section we shall make the following two assumptions whose 
validity was proved by Wald (Theorems 3.1 and 3.2a of [1]) under very general 
conditions. 

AssumPTION A. The space of decision functions is compact, that is, every sequence 
5; of decision procedures possesses a subsequence 5;, that converges to some decision 
function 6*. Here convergence means what Wald calls “regular convergence” (see 
pp. 65-66 of [1]). 

AssumPTION B. If 5; — 6*, then for every distribution v 


[es dv ==> / Rs dv. 


This convergence of integrals implies the pointwise convergence of the risk 
functions, as may be seen by letting the distributions v degenerate at single 
points 6. In some cases (for example, if the loss function is bounded) the two 
notions of convergence are equivalent. 

Let C = sup R;,(@) be the maximum risk of the unrestricted Bayes solution 
(for simplicity assume that 4, is unique; otherwise we would put C = infs, 
supe R;,(@), the inf taken with respect to all Bayes solutions), and let C be the 
maximum risk of the minimax procedure. Then C < C and we may exclude the 
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case C = C as trivial. For any C < C < C let 6(C) be an associated restricted 
Bayes solution, and n(C) = / Rs, @ the corresponding restricted Bayes 


risk. Concerning 7,(C) we have the 


Lemma. The function r,(C) is convex, continuous, and strictly decreasing. 
PROOF. 


(i) r,(C) is obviously nonincreasing. If C’ < C”,0 < y < land 
6 = 76,(C’) + (1 — v)&(C”), 
then 


[ Rea = mC) +0 -Y nC’) 


and 


sup R,(6) S yC’ + (1 — v)C’, 


from which the convexity of r,(C) follows. 

(ii) From well known properties of convex functions, the continuity of r,(C) 
is now obvious except et the point C = C. But let C; | C, let 6; be the corre- 
sponding restricted Bayes solutions and 6;, the convergent subsequence guar- 


anteed by Assumption A. If 5;; — 6*, we have r,(C,) = | Re, dx —> [ Re dx. 


By monotonicity 7(C) 2 / Rix dd. Also, since Rs;\.\ — Rex() for each 6, we 
have that sup Rs«(@) < lim C;, = C, so that sup Rss (@) = C. But this implies 
n(C) s [ Rew ar and hence r(C) = [ Rw dy = lim n,(C;,). 


(iii) Before proving that r,(C) is strictly decreasing we shall now show that 


for any C < C < C we have 
“— Race (6) = C. 


Suppose that sup R;,(@) < C. If C < © there exists 0 < y < 1 so that 
6 = yb, + (1 — y)&(C) still satisfies sup R:(@) < C, but we would have 


[R d, < | Raxco dy. If ¢ = 0, then C; > ¢ implies that / Racey dx\ —> 


/ R3,(@ d\ and the same argument applies. 


(iv) Strict monotonicity of r,(C) is an obvious consequence of (iii). For let 
C’ < C” and suppose that r,(C’) = r,(C”). Then 6,(C’) would be a solution not 
only corresponding to C’ but also to C” in contradiction to (iii). 

We can now state a cldsure and continuity theorem. 

THEOREM 3. If {5;} is a sequence of restricted Bayes solutions converging regularly 
to 6*, then 5* is a restricted Bayes solution, and sups Rix (0) = lim; supe Rs,(8). 

Proor. Let r;, r* be the Bayes risks of 6; , 6* respectively. By Assumption 


| 
; 
: 
t 
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B, r; > r*. By the lemma, we can conclude that the sequence C; = supe R;,(@) is 
convergent; denote lim C; by Cy . Clearly C* = sup Rs (@) 2 Cy, and since for 
each 6 R;:(0) = lim R;,(0) S Co, we conclude C* < Cy = C*. The lemma now 
assures 6* to be a restricted Bayes solution. 

Coro.uary. The set of risk functions corresponding to restricted Bayes solutions 
is closed with respect to the convergence of Assumption B. 

Proor. Let R; be the risk functions corresponding to restricted Bayes solu- 
tions 6; , and let R; — R*. By the compactness Assumption A, we may extract a 
subsequence 6;,; which converges regularly to some 6*. By Theorem 3, 6* is a 
restricted Bayes solution, whose risk function R* is the limit of Rs,, , and hence 
of Rs, . 


5. Extensions. We shall now mention briefly some extensions of the notion of 
a restricted Bayes solution. To give a first simple example, it may happen that 
we have ideas concerning the range of the parameter but not concerning a pos- 
sible distribution over this range. Thus it may be known that @ ¢ 2 and may 
further be indicated by other considerations that actually @ ¢ w where w C Q. 
We may then, subject to the condition R;(@) < Cp for all 6 ¢ Q, wish to minimize 
Supe» 23(@). For example, when testing the hypothesis that three means @, , 
62 , 6; are equal we may believe that the most likely alternatives are such that 
6, < 62 < 6; without however definitely being able to exclude the other possi- 
bilities. 

We can get further refinements as follows. Let Ag C Ay C --- C Api C A, 
be a nested set of families of distributions. We may be certain that the true 
distribution of @ is an element of A, (A, may of course contain all distributions 
that assign probability 1 to a single point), fairly sure that it lies in A,_, , still 
believe that is in A,» , etc. Accordingly we could select a decreasing sequence of 
constants C, > C,.1 > --: > C,, each C; greater than the restricted minimax 


risk at this stage, and minimize supye,, / R; dd subject to the condition supe, ,; 


[ra s C, fort = # +e. 


There is an extension of Theorem | to the present case that we give as an 
example of how the theory of the earlier sections generalizes. 
THEOREM 4. Suppose there exists po > 0 and a distribution 


v0 = podo + 2 vids, ps = 0, 2 pi = A, 


with \; € A; and such that the Bayes solution 5o of vo satisfies 


(1) sup | Rs, dx = 0. = [ Ry, ad. fori =1,+++,r 
Acad 
and 
(2) sup [ Ry ar = | Rs dry. 
he Ag 
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Then 59 minimizes supyer, | R; dd subject to 


(3) sup | Rs dA SC; fori = 1,++-,r. 


AeAG 


Proor. Let 6 be any procedure satisfying (3). Then 


2. i sup | Rs ar - Do f Rs ay; Do f Rs, dy; = >» sup R; an. 


i=O NeAG MAG 


But forz = 1, --- ,r we have 


sup R, dy S 
ACA 
and the conclusion foflows. 


Of the conditions, (2) of course becomes vacuous in case Ao contains only a 
single distribution. 


6. Examples. We conclude the paper by discussing a number of examples 
which serve to illustrate the ideas and theorems. As might be expected, it is more 
difficult to obtain explicit results with the restricted Bayes approach than with 
the logically simpler minimax or Bayes principles. In fact, the minimax prin- 
ciple has been successfully applied, in most cases, by guessing the answer and 
then verifying it through use of the specialized form of Theorem 1. It appears 
that the restricted Bayes solutions are often much less simple in their mathe- 
matical structure than the minimax solutions, and will accordingly be much 
harder to guess. We suspect that the widespread application of the restricted 
Bayes approach would require numerical methods in combination with theo- 
retical results of the kind given above. 

EXamPLe 1. Let X = (X,, Xo, ---, X,) be random variables having the 
joint density function p(x) = c(0)b(x)e“”*, where @ is an unknown real 
parameter and q(@) is a monotonely increasing function of 6. This form includes 
many of the distributions frequently used in statistics, such as the Poisson, 
binomial, and normal with known mean or variance. Consider the problem of 
testing, at a given level of significance, the hypothesis H:@ = 4 against the 
alternatives 6 + 6. We are indifferent to alternatives 6; S 6 S 6, where 
6, < 0 < 6. As risk function, we shall use the probability of false acceptance. 
Thus, the risk is 1 — 8(@), where 8(@) is the power function. Suppose finally 
that past experience or other considerations suggest that, should the hypothesis 
6 = 6 be false, then one of the alternatives 6 2 4, is true. 

It is known [2] that an essentially complete class of tests consists in those of the 
form w(k): reject H if t(x) S kort(x) = f(k), where f(k) is determined by the given 
level of significance. We may restrict attention to these tests. Denote the power of 
w(k) at alternative @ by 8;(6). If we had complete confidence in the presumption 
that either 6 = 6 or 6 = 62, we should seek to maximize the power against the 
latter alternatives, with no regard to the power against the alternatives @ S 6, . 
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This leads to the known uniformly most powerful one-sided test w(— «). This 
test is obtainable as the Bayes test corresponding to any a priori distribution 
for @ which assigns all of the probability to values @ = 6. However, the power 
of w(— «) tends to 0 as @ tends to its lower limit, so we may get- very poor 
performance if our presumption is not correct. At the other extreme, if we placed 
no reliance on the presumption, we might seek the minimax test. It is easy to 
see that the power functions all have unique minima, and are continuous in k 
for fixed 6, whence the minimax test will be w(k), where k is determined by 
the condition 6,(@:) = 6,(62). This test then gives no better protection against 
large alternatives than against small, and thus makes no use at all of our pre- 
sumption that large alternatives are the ones to fear. 

The restricted Bayes approach suggests a compromise, under which we would 
seek to maximize infsz¢,8(@) subject to inf8(@) = C. It can be shown that, for 
—« <k&k, infeze,8:(0) = Bx(62), while infoS,(6) is attained at a finite value 
of 6 < 6,. From these facts the Lemma of [2] enables us to conclude, for k’ < 
k<k’,k S k, that infors,6.(0) > infere,8--(0), while infe8,(6) > infeS,-(@). 
It follows that for every — © < k S k, w(k) is a restricted Bayes solution in the 
sense given. The same result holds if we assign to 6, any a priori distribution 
under which P(@ = 6.) = 1, and apply the restricted Bayes principle in the 
narrower sense of Section 2. 

It is easily seen that C(k) = inf,8,(6@) is a continuous, monotonely increasing 
function of k in the interval —» < k S k. The tests w(k), k < k, thus provide 
essentially unique restricted Bayes solutions for all possible values of C. In this 
example, our principle provides nothing essentially new, since the admissible 
tests already form only a one-parameter family. 

EXxamMPLeE 2. Consider next the binomial random variable X = number of 
successes on n independent trials, each having the probability p of success, and 
the problem of estimating p from X. Take as loss function the square of the 
error of estimate. Suppose that a theoretical examination of the experimental 
situation reveals considerations of symmetry which suggest that p = 4. We 
wish to design an estimate which will take advantage of this theory, in the sense 
of providing small risk at p = 3, but will not place complete reliance in the 
theory, in the sense of giving some control over the risk for all values of p. 
This problem falls within the framework of the restricted Bayes approach, if we 
give to p the a priori distribution \ which assigns all of its probability to the 
value 3. Our objective is then to minimize the risk at 3, subject to a given maxi- 
mum C for the risk over 0 S p S 1. 

Denote the estimate corresponding to a value x of X by 4(x), and the risk 
involved in using this estimate by Rs(p) = E[6(X) — p]’. The ordinary Bayes 
estimate is 5(x) = 4 for every x, since this estimate reduces the risk at } to 0, 
while every other estimate has positive risk at }. The maximum risk of 5 is C = 4 


a 
attained at p = 0 and p = 1. The minimax estimate for this problem is known 


F 1 
(see [3]) to be 6(z) = iy = + Xa/n + 1) . Thisestimate has the constant 


risk C = 14(/n + 1)’. 
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In getting the restricted Bayes estimates, we first observe that we need only 
consider those estimates which possess the symmetry property 5(z) + 6(n — x) = 
1. For, if 5(z) is any estimate, the estimate 6’(r) = 1 — 6(n — z) will have the 
same maximum risk and the same Bayes risk as 6, for any a priori distribution 
which is symmetric about p = 1/2. Thus, the estimate }(4(z) + 6’(z), which 
possesses the symmetry property cited, will have the same Bayes risk as 6 
and no larger maximum risk. 

Consider the distribution 4; which assigns probability 1/2 to each of the points 
0 and 1. The Bayes solution 6, corresponding to the a priori distribution pA + 
(1 — p): is easily found to be of the form: 6,(0) = 1 — 4,(m), 6:(x) = 1/2 for 
0 < x < n. By virtue of Theorem 2, 6; is a restricted Bayes estimate if it achieves 








BAYES RISK 


MAXIMUM RISK 


its maximum risk only at 0 and 1. But this is true for R(p) = (p —})*, and hence 
by continuity (Theorem 3) must hold true for some interval (C,, C) of values 
of C. In fact, C; may be calculated from the condition R’,(0) = 0. Again using 
the continuity of the variation of the risk function with C, we see that for some 
interval (C2, C;), the distribution ye, will consist of probability 1/2 at points a 
and 1 — a, the value of a varying continuously with C. At C = C,, the risk 
function will develop further maxima, requiring a modification of the form of the 
distribution y, and so forth. But in any case, the distribution » must have only 
finitely many points of positive probability, since the risk function must achieve 


its maximum at all such points, is a polynomial in p, and is not constant except 
forC =C 


The computing program outlined in the preceding paragraph was carried out 
numerically for the case n = 4, leading to the relation between C and R(1/2) 


: 
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shown in the graph. The restricted Bayes estimates are (except for the extremes 
of minimax and Bayes estimates) not linear functions of X. For comparison, the 
graph also shows the minimum risk at p = 1/2 attainable for given maximum 
risk using only linear estimates. We see that, over a wide range of values of C, 
the use of nonlinear estimates permits nearly a 50 per cent reduction in the risk 
at p = 1/2. 

EXxampP_e 3. As an illustration of the application of our principle to a finite 
decision problem, consider the following genetic situation. We are concerned 
with the inheritance of a simple Mendelian trait. Two individuals F and G are 
crossed to produce n progeny, each of whom is then crossed with a known hybrid 
to produce a single offspring. Of the n third-generation individuals, R are found 
to be recessive, while the remaining n — R are either dominant or hybrid. 
Suppose it is known from other evidence that ¥ and G are neither both dominant 
nor both recessive. Then the number k of recessive genes which they possess 
between them is either 1, 2, or 3. Our problem is to infer the value of k from the 
observed value of R. As our risk, we take the probability of wrong inference. 

It is easily seen that R has the binomial distribution corresponding to p = k/8. 
The complete class of inference procedures is obtainable as the class of Bayes 
procedures corresponding to a priori distributions \ over the three possible values 
of p. If P(p = 7/8) = 4; , 7 = 1, 2,3, then the Bayes solution, when R is observed 
to have the value r, is to decide for that value of k for which 


he(e)(k/8)'(1 — k/8)"” 


is greatest. These solutions have the following structure. There exist two numbers 
a and b, such that our decision is fork = 1 if R < a, fork = 2ifa < R < b, for 
k = 3 if b < R, while if R = a, we choose between k = 1 and k = 2, and if 
R = b, we choose between k = 2 and k = 3 according to certain probabilities. 
Let P(choosing k = 1|R = a) = m,, and P(choosing k = 2|R = b) = m. 

Suppose the proportions of dominant and recessive genes in the population at 
large are known to be uw and 1 — uy, respectively. Then, if F and G are bred under 


panmixia (i.e., chosen independently and randomly from the population), we 
should have 


P(k = 1):P(k = 2):P(k = 3) = 2(1 — w)*:3u(1 — w)2 2p’. 


The Bayes solution corresponding to this distribution for k would be the reason- 
able decision procedure to use if we were sure that F and G had been bred under 
panmixia. If we placed no reliance at all in the panmixia hypothesis, we might 
prefer to employ the minimax solution, which is characterized by equal proba- 
bilities of error corresponding to the three possible values of k. If we placed some 
reliance in the panmixia hypothesis, but not complete reliance, we might impose 
a limit on the permissible probability of error for any value of k, and subject to 
this limit seek to minimize the average probability of error under panmixia. 

The minimax, Bayes, and restricted Bayes solutions are easy to obtain numer- 


ically. For illustration, suppose n = 20 and » = 0.8. The three solutions are as 
follows. 
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Solution m1 | ®2 


cn et eee | | 0.482 | 0.142 
RS ocak «nthe phan mean Ah é 66a aaa nade bE J -— t oes 7 sas 
Restricted Bayes, maximum probability of | | 


error = s | 0.868 | 0.828 








The performance characteristic properties of the three solutions may be con- 
veniently compared in tabular form. 


. Maximum probability Average probability of 
Solution of error error under panmizia 





0.354 0.354 
0.500 0.239 
0.234 





The restricted Bayes solution loses little efficiency as compared with the Bayes 
solution if panmixia holds, but gives considerably better protection if it does not 
hold. 

It may be remarked that, in any finite decision problem, the restricted Bayes 
solution may be found by means of a finite number of applications of the Ney- 
man-Pearson fundamental lemma. Suppose there are m decisions, so that the 
risks associated with any decision procedure may be represented as a vector 
(r: , 72, °** , 7m) in m-dimensional Euclidean space. Except in the trivial situation 
in which the Bayes solution itself satisfies the restrictive condition that r; S C 
for every i = 1, 2, --- , m, we may conclude from part (iii) of the proof of the 
Lemma of Section 3, that the restricted Bayes solution will have r; = C for 
at least one 7. Let J(C) be the set of 7 such that r; = C. The restricted Bayes 
solution corresponding to C may then be obtained by minimizing }>A,r; , sub- 
ject to r; = C for all 7 in J(C). If we compute these minimizing solutions for all 
sets J, using the Neyman-Pearson lemma, we may select the restricted Bayes 
solution from among them by inspection. 
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ON THE EXISTENCE OF LEAST FAVORABLE DISTRIBUTIONS! 


By E. L. Leamann 
Stanford University and University of California, Berkeley 


1. Summary. Sufficient conditions for the existence of a least favorable dis- 
tribution were given by Wald in his work on general decision theory. It is shown 
here that for problems of hypothesis testing and more generally for multiple 
decision problems involving a finite number of decisions, the result holds under 


a much weaker restriction than Wald’s assumption of a compact parameter 
space. 


2. Introduction. In his general theory of decision functions Wald has given 
conditions under which there exists a least favorable distribution for Nature. 
One of these, which is rather restrictive and not required for many parts of the 
theory, is condition (3.7) of [1], a compactness assumption on the parameter 
space. This condition can, of course, in general not be dispensed with; there are 
many examples of simple statistical decision problems for which a least favorable 
distribution does not exist. However, as we shall show below, for certain special 
classes of problems the compactness assumption is not required. 

The following is a typical example. Suppose that @ is a location parameter 
and that we are interested in.testing H:@ < 6 against K:6 = 6,. If a least 
favorable distribution does not exist this means essentially that positive proba- 
bility is assigned to at least one of the points @ = +. But it is intuitively 
clear that by doing this, Nature would be playing into the hands of the statisti- 
cian, since for sufficiently large | @| it is very easy to determine whether or 
not H is true. In fact one would expect Nature to do better if the above strategy 
S were replaced by the (conditional) distribution for @ obtained from S, given 
that no probability is placed on 6 = +”. 

In the next section we shall make this argument precise and use it to estab- 
lish the existence of a least favorable distribution for certain hypothesis testing 
and multiple decision problems. In particular our condition is satisfied for many 
problems of testing a composite hypothesis against a simple alternative. This 
shows that a method given in [2] for determining the most powerful test against 


a simple alternative is applicable in most problems of the kind usually con- 
sidered. 


3. Least favorable distributions for problems of hypothesis testing. In the 
present section we shall consider the hypothesis H that the probability density 
of a random variable X is f(x) with f ¢ , where F is some given class of densities, 
and the class of alternatives K that the density of X is ge(x) with @ ¢ 2. We 
shall assume that the sample space is Euclidean and that 6 = (0, --- , 4), 
where © is x. Borel set in R, . Since throughout we shall be concerned with dis- 
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tributions over 2 we may, by defining these distributions to be zero outside of 
©, assume without loss of generality that 2 is the full Euclidean space R, . We 
assume further that for almost all x, ge(x) is continuous in @ and measurable 
inQ X &. 

For the present we consider the usual asymmetric formulation of the problem 
in which a level of significance a is assigned and it is desired to maximize the 
minimum power of the test over K. In this situation, as is pointed out on page 
133 of [1], assumptions (3.1) — (3.6) of [1] hold, and we have, as a simple con- 
sequence of Theorem 3.12 of [1], 

Lema 3.1. There exists a level-a test of H that maximizes the minimum power 
against K, and a sequence of distributions \; over Q such that 


(3.1) lime / E,6(X) dd; (0) = inf E,o(X) 
tc 62 
and 
(3.2) lim 6; = inf E,¢(X), 
62 


t—+00 


where 8; is the power of the most powerful level-« test for testing H against the simple 
alternative 


| an(2) ar) 


Now by Helly’s compactness theorem there exists a subsequence of the se- 
quence {\;}, which without loss of generality we shall take to be the original 
sequence, such that 


(3.3) \i > ve 


for all continuity intervals of u, where u is again a distribution and 0 S y S 1. 
If here we could assume that y = 1 it would follow that u is least favorable 
(see the proof of Theorem 3.14 of [1]). We shall now show that yu is least favor- 
able by proving that either y = 1 or lim 8; = 1 under the following 

AssuMPTION A. Given any « > 0 and any closed bounded set w C Q there exists 
a Borel set S in the sample space such that 


P(S|\f) s for all f € &, 
(3.4) 

P(S | ge) for all 0 € w, 
and 
(3.5) P(S | ge) > 0 uniformly as 6} + ++: + > @. 


Clearly Assumption A is satisfied if both ¥ and Q are compact, but as we shall 
show later the assumption also holds in many cases in whiclk(3.7) of [1] is not 
satisfied. 

The proof of our result is based on the following two 'emmas. 
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Lemma 3.2. Let w be any closed bounded set in Q and let « > 0. Then there exists a 
Borel set S in X and an integer io such that 


(3.6) [ PPA 2-428 fri xi. 


and even 


IV 


(3.7) [ Eelo(X)eg(X)1 ds) F1—y—2% fori z wy, 


where @ is the test referred to in Lemma 3.1 and where cg(x) ts the characteristic set 
funetion of S. 


Here and in what follows the notation P(S | @) and EK, indicates that the 
probability or expectation is computed with respect to the probability density 
Jo(x). 

Lema 3.3. For any € > 0 there exists a continuity interval w of u such that for 
any test 


(3.8) | Fu6(X) as) 2 y | Feg(X) dulo) - 
for sufficiently large i. 
Before proving these lemmas we shall show that they imply y = 1 or lim 6; = 1 


and hence the existence of a least favorable distribution. Let @ be the test re- 
ferred to in Lemma 3.1 and let 


(3.9) lim | £¢(X) dy; (6) = B. 


Given any e > 0 let w be a bounded subset of 2 for which (3.8) holds. Then 
l Evg(X) ads(0) = | Exo(X) as(0) + | Bog(X) ars), 

where for sufficiently large 7 the first term is = y | Eep(X) du(@) — « by (3.8) 

and the second term is 2 1 — y — 2e by (3.7), so that 

(3.10) ge(l—y+ y | Bro(X) du(6) = [ mec) du(6). 

Here the last inequality is strict and therefore contradicts (3.1), unless either 
y= 1 or | Beo(X) Cu(6) = 1. 

But in the latter case 8 = 1 by (3.10), so that 
[ E,@(X) du(@) = inf Ee¢(X) 


and yu would be least favorable. 
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Proor or Lemma 3.2. Let S be a set guaranteed by Assumption A for which 
(3.11) P(S | 6) S «/2 for all @ € w, 
(3.12) P(S\f) Se for all f € F, 
and such that 
(3.13) P(S | 6) — 0 uniformly as 6} + --- + #@&— @. 

From (3.3) and (3.13) it follows that 


(3.14) [Pe 16) ds) F1—y—«/2 for i 2 te, 
2 


and (3.6) is an immediate consequence of (3.14) and (3.11). 
Suppose now that (3.7) did not hold. Then there would exist a subsequence of 
{\;}, which we may again take to be the full sequence such that 


(3.15) lim [ Ey [¢(X)es(X)] dd; (0) = 8 <1 — 7. 


io 


We define a new test ¢* by 


1 
(3.16) o*(z) = i = . $(z) 


Then for any f ¢ § we have, because of (3.12) 
(3.17) E@XX) |) $9—fa+PB|f <a, 
so that ¢* is again a level-a test. Also, for all z, 


(3.18) o*(z) = * = © o(x) + eg(x)[1 — ¢(z)], 


and hence 


[e*20) a = °— | Be) a) 
(3.19) 


+ | Bsfes(X)I1 — 6X1) a0) 


The first term on the right-hand side of (3.19) tends to Bla — €)/aasi— ~. 
On the other hand the second term is greater than or equal to 


[ PS) a — [ Bvles(X4(X)] a), 


which for sufficiently large i exceeds (1 — y — €) — (6 + e) by (3.15) and (3.6). 
This shows that for sufficiently large 7 
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[E10 aes c4 2 


2 
and thus contradicts (3.2), since it implies that for sufficiently large zi ¢* is 
more powerful than the most powerful test for testing H against / go(x) dd,(8). 
Proor or LemMMa 3.3. Let w be a continuity interval of yu, and so large that 
(3.20) u(@) S ¢/2. 


Then by the Helly-Bray theorem, asi— 
[ a0) ar 7 | gn(e) auto), 


and hence by Fatou’s lemma 


lim int [ | om) f ge (x) ar«(0) | dz = r | [6 / go (x) ano) dx. 


Interchanging the order of integration we then have for 7 sufficiently large 
[ 0X) a = 7 | BroX) du) — (2 = | Bed) dul) - « 
w w Q 


by (3.20). 

We can sum up the work of this section in 

THEOREM 3.1. If ge(x) is continuous in @ and if Assumption A holds, then for 
the problem of testing H against K there exists a least favorable distribution for @. 

As an illustration, let X,, --- , X, be a sample from a distribution with 
density f(z — 6) and consider testing H:@ S 4 against 6 = 6, . Here we could 
clearly take for S a set of the form X; S c, so that Assumption A is satisfied. 


4. Testing against a simple alternative. As an application of Theorem 3.1 we 
now consider the problem of testing a composite hypothesis against a simple 
alternative. Let the hypothesis state that the density of X is fe(x), @ « 2, and 
let the alternative be g(x), where we assume as before that the sample space is 
Euclidean and that @ = (6;, --- , 6,) with Q being the full Euclidean space R, . 

AssumpTION B. For every closed bounded set S in the sample space, P(S | fe) + 0 
uniformly as 6; 4+... + G— ow, 

TuHeoreM 4.1. If fe(x) is a continuous function of @ for almost all x, then under 
Assumption B there exists a least favorable distribution over Q. 

Proor. Theorem 3.1 clearly applies if we interchange H, a with K, 8. We 
therefore only need to show that Assumption B implies Assumption A with 
f and g interchanged. That is, we need to prove that Assumption B implies the 
existence of a set S such that 


(4.1) P(S\9) S«¢, 


(4.2) P(S|fe) S « for all 6 € w, 
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and 
(4.3) P(S|fe) ~Oas Oi +--+ +@— @, 


It was pointed out by Scheffé [3] that when ge(x) is continuous in 6, the con- 
vergence 6; — 6 implies 


(4.4) [ go, (x) dx — [ ge (x) dx uniformly for all Borel sets S. 
8 8 


Therefore if w is bounded and closed, the associated set of distributions is com- 
pact with respect to the convergence definition (4.4). Let « > 0. Then we can 
find a finite number of points in w, say 6, --- , 6, such that every 6 € w is 
within }¢ of one of these @; in the sense that | P(S | 0) — P(S | 6;)| S 4e for all 
Borel sets S. It follows that there exists a closed bounded set S for which (4.1) 
and (4.2) hold and (4.3) then follows from Assumption B. 

AssumPpTION C. There exist s statistics Y; = h\(X),i = 1, --- , 8, such that the 
h; are continuous, the marginal distribution of Y; depends only on @;, and Y; 
tends to + or —~ as 0; —> +0 or —o@, 

Lemma 4.1. A sufficient condition for Assumption B to hold is Assumption C. 

Proor. Let S be a closed bounded set, and let a; = mins h;(x), b; = maxs h,(x). 
Then P,(X € S) S Po,(a; S$ Y; S b;) fori = 1, --- ,s.Nowifoji+---+@8>C 
we must have 6; > C/s for at least one value of 7. Given ¢ > 0, let C be so large 
that 


Po, (a; S Y¥; Sb) <e if 6 > for all 7. 


Then P)(X ¢ S) S e provided 6} + --- + #@>C. 

As an example let X, , --- , X, be a sample from a distribution with unknown 
location and scale parameter — and n. Let 6, = &, 62 = log 7, and take Y,; = 
X,/| X2 — Xi | , Yo = log | X2 — X,| . Then Assumption C is seen to be satisfied, 
so that for testing a hypothesis of this type against a simple alternative, a least 
favorable distribution exists. 

Theorem 4.1 answers a problem raised by [2], where in Theorem 1 a method 
is given for proving that a test is most powerful for testing a composite hypothesis 
against a simple alternative. Combining Theorem 4.1 with Theorem 3.10 of [1], 
we see that this method is always applicable when Assumption B is satisfied. 

While it is quite likely that Assumption B can be weakened somewhat, it is 
perhaps of interest to point out that some condition of this type is required, 
which restricts the behavior of the distributions as 6; + --- + 62 — ~. As 
an example consider the following situation in which & is denumerable apd the 
densities are given by 


—He-i)? ) —He-1/i))? . 
er eee € i=m,m+1,---, 


1 
H:f,(x) = 2n/ 2m le 


1 —tz 
K:9(x) Sat 








ssenpenneitae = + 
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We shall show that if m is sufficiently large the most powerful level-a test rejects 
when x S b, where b is determined by 


b b 
(4.5) lim [ fi(x) dx =} [ g(x) dx = a. 
b 
First one checks easily that for large 7 a(z) = / fi(x) dx is an increasing 


function of 7. Let m be such that a(7) is increasing for i 2 m. Then the proposed 


test is of size a and power 2a by (4.5). But if 8 is the power of the most powerful 
test @ we clearly have 


8 Ss 2 lim sup / f(z) ¢ (x) dr S 2a, 
io 
which proves that the region of rejection x S b is most powerful. If a least 
favorable distribution \ over 2 existed, the test x < b would be a Bayes solution 


for \ (Theorem 3.9 of [1]), that is, would be most powerful for testing [ t@) dx(t) 


against g(x). But an application of the Neyman-Pearson fundamental lemma 
shows immediately that no Bayes solution is of this form. 

It may be worth pointing out that the conditions of the present paper are 
really of a quite different nature from those given by Wald in his general theory. 
Thus they do net even imply that the parameter space is weakly compact in 
the sense of (3.1) of [1]. As an example, consider a random variable X the dis- 
tribution of which depends on an unknown location parameter @. Let H denote 
the hypothesis 6 S 4 and suppose that the simple alternative is 6; > 6. Let 
{A,} be any sequence of distributions over H, and let ¢(x) be any test. Then 
weak compactness of H would imply the existence of a subsequence {A,;} and a 
distribution \» over H such that 


(4.6) lim sup [ Es (2) dds, 0) < [ Boo (2) ds ©). 


je 


But let ¢(x) be the characteristic set function of the set x < C and let d;(@) 
assign probability 1 to the point @ = —7. Then the left-hand side of (4.6) is 1, 
while for any distribution \o the right-hand side is <1, so that H is not weakly 
compact. On the other hand, Assumption B is satisfied. 


5. Some extensions. We shall now indicate briefly how the results of Section 
3 may be extended to somewhat more general decision problems. As 2 first 
generalization consider the problem of hypothesis testing, formulated as in 
Section 3 except that the loss function need no longer be simple. Suppose that 
acceptance of the hypothesis when the true distribution is given by ge(x), 0 Q 
results in a loss W(@), and that V(f) is the loss resulting from rejection of H 
when f is the true density. We shall assume that V and W are bounded and 
that we are interested in minimizing supe W(6)E{1 — ¢(x)] among all tests ¢ 
for which V(f)E[¢(x) | f] S a@ for all f e &. 
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Let Assumption A’ be obtained from Assumption A by replacing P(S | ge) 
and P(S | ge) in (3.4) and (3.5) by W(@)P(S | ge) and W(6)P(S | ge) respectively, 
and P(S | f) in (3.4) by V(f)P(S | f). Then Assumption A’ implies the existence 
of a least favorable distribution over 2. Only the obvious changes are required 
in the proof of Theorem 3.1. 

As an immediate further generalization one next obtains an analogous result 
for the following two-decision problem. The parameter space is partitioned into 
two set w; U w,. The loss is zero if 6 € w; and decision d; is taken; it is W,(@) if 


7 


decision d; is taken incorrectly. Let us denote the risk function of a decision 
procedure 6 as usual by R;(@) and suppose that if 6 is the minimax solution 


sup R; (0) = y. 


Then the overall minimax problem is equivalent (see [4]) to the problem I, 
of minimizing sups.., Rs(@) subject to R:(@) < vy for all @ € w, and also to the 
problem II, obtained from II, by interchanging 1 and 2. If a least favorable 
distribution over w; exists for II; (¢ = 1, 2), then one exists for the overall 
problem. But each of the partial problems is of the type discussed at the begin- 
ning of this section. | 

The whole argument extends without much difficulty to multiple decision 
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problems involving a finite number of decisions and having a bounded loss func- 
tion. We shall not give the details but simply state the result. Let o, , --- , wx 
be the regions in the parameter space in which the decisions d,, --- , dx are 
appropriate so that the loss W(6, d;) = 0 if 6 € w;. Then we consider the two- 
decision problems II; (¢ = 1, --- , K), where the decision lies only between 
6€w; and @6¢Q2 — w;. A least favorable distribution exists over 2 provided each 
of the problems II; satisfies Assumption A’. 

As an example consider the case that X,, ---,Xm;¥i,°-:, Y,arem+n 
independent random variables, and that the density of the X’s is f(x — &) while 
that of the Y’s is g(y — n). Suppose that the partition of 2 is as shown in the 
diagram and that the loss is 0 or 1 as the correct or an incorrect decision is 
taken. Then a least favorable distribution exists. To show that I]; satisfies 
Assumption A’ suppose that the bounding rays /; and J, of w; are given by 
n = mé and 7 = m&. Then for S we may take a set in the sample space of the 
form 


2 2 
mty2R, m+tasySmrate, 


where R, c; and ce must be chosen sufficiently large. 
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SUFFICIENT STATISTICS AND SELECTION DEPENDING 
ON THE PARAMETER 


By D. A. S. Fraser 


University of Toronto 


1. Summary. The concept of “functional sufficiency” or “‘f-sufficiency”’ for a 
class of density functions is introduced and conditions given under which it 
corresponds to sufficiency as defined by Halmos and Savage [2]. A minimal 
f-sufficient statistic is defined and shown to exist, and its construction is given. 

The minimal f-sufficient statistic for a class of densities for which the region 
of positive density varies with the parameter is shown to be equivalent to the 
combination of a “statistic of selection” and the minimal f-sufficient statistic 
for a class of densities for which the region of positive density is fixed. The 
construction of sufficient statistics in this latter case subject to certain condi- 
tions of regularity has been treated by Koopman [1]. 

If the parameter is a parameter of selection from a fixed distribution, then 
the statistic of selection is the minimal f-sufficient statistic. If in addition the 
regions of positive density are monotone and indexed monotonely by a real 
parameter, then the statistic of selection is sufficient according to the Halmos 
and Savage definition. Three examples are given to illustrate the results. 


2. Introduction. The following notation follows closely that introduced in [2] 
by Halmos and Savage. Let X be a general space and S a Borel class over it; 
then (X, S) is called a measurable space. Since X will be considered the space 
of a chance quantity, a statistic T is a function over X, that is, a transformation 
from X into a measurable space (7, S’). The transformation is measurable if 
the inverse transformation of the Borel sets S’ are elements of S. 

Let 9m = {yu} be a class of probability measures over the space X. If « and » 
are two measures on X, v is absolutely continuous with respect to u, insymbols 
v <u, if »(L) = O for every E ¢« S for which p(£) = 0. A set of measures IN 
on X will be called dominated if there exists a measure A on X such that for 
each uw ¢ IN we have uw <\, in notation MN < AX. 

In this paper we consider only dominated sets of measures IN < A. The Radon- 
Nikodym Theorem gives us the following statement: 

For any dominated set of measures M <K , there exists a set of nonnegative real- 
valued functions over X, {f,(x)}, such that 


u(E) = [ falx) dd(z) 


for every » « M and E « S. The functions f,(x) are unique except on a set of d- 
measure zero. We shall refer to f,(x) as a density function relative to the fixed 
measure X. 
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For any such class of measures and a corresponding set of densities, this 
paper presents theorems concerning sufficient statistics. 


3. Definition of sufficient statistic. The concept of sufficient statistic was 
given a rigorous formulation in [2]. In words the definition is as follows. 

T is sufficient for Mm if there exists for almost all (uT~) values of T a conditronal 
probability function which is independent of u € M. 

Corollary 1 to Theorem 1 in [2] gives an equivalent condition for a sufficient 
statistic: 

The statistic T is sufficient for a dominated set of measures if and only if f,(x) 
factors in the form f,(x) = gu(T)h(x) (except on a set of u-measure zero), where 
g.(T) ts measurable, g and h are nonnegative, and h and gh are integrable with 
respect to X. 

For the purposes of this paper we introduce the concept of functional suffi- 
ciency with respect to a class of density functions {f,(x)} over a fixed measure X. 
For these density functions » can be considered as a parameter or index of the 
family. A function T(x) is functionally sufficient (f-sufficient) for {f,(x)} if and 
only if fy(x) = g,(T)h(x), where g,(T), h(x) are nonnegative. For the study of 
f-sufficiency the normalization and integrability conditions on f,(x) are not im- 
portant; however, the property that f,(z) 2 O will be assumed throughout. A 
function T(x) is a minimal f-sufficient statistic’ for {f,(x)} if no function of T(x) 
(other than 1-1) is f-sufficient for {f,(x)}. 

Lemma 1. For any {f,(x)} there exists a minimal f-sufficient statistic. 

Proor. The minimal f-sufficient statistic will be given as a mapping of the 
elements of X onto a class of disjoint subsets covering X. The mapping is from 
the elements of a set to the set itself. Thus we need only define the disjoint 
sets covering X. Define sets as follows: 


E, = {x | f,(x) is independent of yz}, 


Ey 


{x | Zh(x) such that f,(z) = h(x)f,(z’)}. 


By this procedure the whole space X can be covered. Also a simple argument 
shows that the sets are disjoint. 

We must now show that these sets provide us with an f-sufficient statistic. 
Let T index the sets and T(x) be the mapping from z to the set containing z. 
Then we have either f,(x) = Ao(x), or f(x) = hr(x)f,(x’), where x’ = 2’(T). 
But this implies f,(z) = g,(T)h(x), and hence T is f-sufficient. 

For any function 7’(7’) other than 1-1 there would exist at least two sets 
E’, E” giving the same value to the function 7’. Over E’, E” the representation 
f,(x) = g,(T’)h(x) is impossible, since it would imply that the sets were iden- 
tical. Thus T is a minimal f-sufficient statistic. 


1 The concept of a minimal f-sufficient statistic was obtained independently of [4]. The 
partition of X induced by the minimal f-sufficient statistic is essentially the partition pro- 
duced by the operator 3 introduced by Lehmann and Scheffé. 
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Lemma 2. There is a unique minimal f-sufficient statistic and it is a function of 
any other f-sufficient statistic. 

Proor. Let 7'(x) be any f-sufficient statistic: then f,(z) = g,(7T)h(x). Con- 
sider the sets E corresponding to the partition of X induced by the function 
T(x). Within any one £ of the sets 


Su(z) = g.(E)h(z). 


Hence E£ is contained in a set of the partition induced by the minimal f-sufficient 
statistic defined in Lemma 1 and therefore that minimal f-sufficient statistic is 
a function of T(z). This with the definition of minimal f-sufficient statistic 
establishes uniqueness. 

LremMa 3. Any sufficient statistic for a dominated set of measures M <K d is an 
f-sufficient statistic for an equivalent set of densities (relative to d). 

Proor. Let T be any sufficient statistic for @. By Corollary 1 to Theorem 1 
in [2], there exists a set of densities {f,(x)} such that f,(r) = g,(T)h(x) except 
on a set of uw-measure zero. An equivalent set of densities is {g,(7')h(x)} and 
these factor for all values of x. Hence T is f-sufficient for {f,(x)}. 

Lemma 4. An f-sufficient statistic T for {f,(x)} is sufficient for {u} = OM if and 
only if f,(x) = gy(T)h(x) where T(x) is measurable, g,(T) is measurable, and h 
and gh are integrable with respect to X. 

Proor. Follows immediately from Corollary 1, Theorem 1 [2]. 

The structure of f-sufficiency, unlike sufficiency, is not invariant under changes 
in {f,(z)} which do not alter the set IN. However for applications the conditions 
in Lemma 4 will usually be fulfilled, and consequently any procedure for ob- 
taining f-sufficient statistics will assist the study of sufficient statistics. 


4. Selection. Consider a set of densities{f,(x)} over a space X. Considering 
# as an index or parameter of the class, we define a parameter of selection. 
u is a “parameter of selection” for {f,(x)} if 


f(z) = o8,(z)f(x)g(u) , 
where Sy = {x | f,(x) > 0} and s(x) = 0, 1, according as x ¢ S, € S. 

If there is a class of measures 9% which are essentially truncations of, or 
selections from a fixed measure, then there will exist an equivalent set of densi- 
ties for which yu is a “parameter of selection.” 

We now define a “statistic of selection” for any set of densities {f,(r)}. It is 
a function mapping X into the space of subsets of X. 

T(x), a statistic of selection, is defined by 


T(z) = NS,, 


where the intersection is over all u « M*(x) = {ul|xeS,} = {ul f(x) > O}. 
We also define a characteristic function for sets A and B C X: 


WA, B) =O0f ACB, 
=1ifA CB. 
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5. F-sufficiency and the statistic of selection. A set of measures 9M is said to 
be homogeneous if vy < uw and uw < » for every pair u, v e« NM. Thus a dominated 
set of measures with densities {f,(2)} is homogeneous if S, is independent of yu. 
In such a case the Halmos and Savage criterion of sufficiency is simplified, and 
if working over the real space subject to certain continuity conditions on the 
f,(x) the problem of sufficiency has been treated by Koopman [1]. 

The theorem in this section reduces the problem of finding an f-sufficient (or 
minimal f-sufficient) statistic for a set of densities corresponding to a dominated 
set of measures to that of finding an f-sufficient (or minimal f-sufficient) statistic 
for the special type of densities (mentioned above) corresponding to a homo- 
geneous set of measures. Application of these results for sufficiency then rests 


on Lemmas 3 and 4 and the fact that in applications sufficiency and f-sufficiency 
will usually be the same. 


TueoreM 1. For a class of densities f,(x) relative to a fixed measure \ on X, the 
minimal f-sufficient statistic is the combination of the statistic of selection and the 


minimal f-sufficient statistic for a class of densities for which S, is independent of 
u (the carrier independent of the parameter). 


Proor. With no loss of generality we can assume US, = X, where the union 
is over all u € MM. 


We first show the equivalence of the two characteristic functions ¢s,(x) and 
¥(T(x), S,), where T(x) is the statistic of selection. 


¢s,(x) = 0, 1 
implies 
2¢B,; £€ Bas 
which implies 
T(z) FS8,, Tle) CS,, 
which implies 
¥(T, S,) = 0, 1. 
Hence 
s,(t) = ¥(T(z), S,). 
The density function f,(x) can be written as follows: 
I(x) = $s, (x) f(z) 
WT, S,)fu(z) 
VT, Sifu(z), 


(5.1) 


where 


f(x) = f(z) if xe S,, 


= g,(x) ifx¢S,. 
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g(x) is chosen everywhere greater than zero and of a functional form intro- 
duced later in the proof; it can as shown in the proof be chosen independent of 
u, that is g,(z) = g(x). 

The functions f,(x) are everywhere positive and hence the carrier 5, is inde- 
pendent of the parameter yu. The choice of function g,(z) or g(x) still has a high 
degree of arbitrariness, and will be made in application in such a way as to 
facilitate the determination of a minimal f-sufficient statistic for {f,(r)}. 

Let T’, T” be minimal f-sufficient statistics for {f,(r)}, {f,(r)}, then 


(5.2) f(z) = gu(T’)h(zx), 
J.(z) = 9,(T”)h(z). 
Substituting (5.2) in (5.1), we obtain 
f(x) ~ V(T, S,)9.(T” )h(z). 
Thus (7, 7”) is an f-sufficient statistic for {f,(2)}, and we need only establish 
that it is minimal. 

For the last section of the proof, we shall need to know that 7(zx) is constant 
valued for all x for which 7” has a fixed value. This is true since T is a function 
aT’: 

T =f, 
where the intersection is over all u « M*(x) = {u| f,(xz) > 0} = {ul g,(T’) > 0}. 

As in Lemma 1, we study the functions 7’(x) and (T(x), T”(x)) by consider- 
ing the partitions they induce on the space X. Any set of the partition is thus 
the set of points for which the function takes a constant value. For the partition 
induced by (7, T”), we shall show that any set is also a set of the partition 
corresponding to T’(x). Thus 7” and (T, 7”) can be put into 1-1 correspondence 
and hence (7', 7”) is minimal f-sufficient. 

Let E be any set of the partition of X corresponding to (T, T”); then 


Ey = {x| T(x) = T(z’); Dh(z) af,(x) = h(x)f,(z’) for all pu} 
| T(x) = T(x’); Dh(x) a f,(x) = h(x)f,(x’) for all u for which 
f S, D> T(x), and g,(x) = h(x)g,(x’) for all » for which S, > T(zx)} 
‘ T(x) = T(x’); Ah(x) a f,(x) = h(x)f,(x’) for all wu, and 
— |. g.(z) = h(z)g,(z’) for all u for which S, > T(z) hn 


(5.4) = 


| Ah(x) a fu(z) = h(x)f,(x’) for all w, and g,(z) = h(x)g,(z’) 
rE | for all » for which S, > T(x) 


(5.4) follows from (5.3) since it was shown above that T(x) = T(z’) is a conse- 
quence of 7’(x) = T’(z’). 


| eae) a f(x) = h(x)f,(x’) for all u, and g,(r) = 
*| p(2)g0(2’) for all u for which S, > T(z) 
| Th(x) a f,(x) = h(x)f,(z’) for all u}, 
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if g(x), which so far is only restricted to positive values, is given the following 
functional form: 


9u(x) ~ ¢.(T) fon (zx) 


where v,(7(x)) can be any element of SM for which S, > T(x). Thus £ is a set 
of the partition corresponding to T’. This completes the proof of Theorem 1. 
As remarked in the proof, g,(x) can be chosen independent of u, as for example 


g(x) = C(T) fr) (z) 


where v(7(x)) can be any element of MN for which S, D T(z). 

In a recent paper [3] R. C. Davis has investigated sufficient statistics for 
density functions on R’ satisfying certain regularity conditions and having the 
upper and lower extremities of the range of the distribution depend on the param- 
eter. The proofs of necessity in Theorems 1 and 2 in [3] follow immediately from 


Lemma 4 and the theorem in this section by noting that in each case the statistic 
considered is equivalent to the statistic of selection. 


6. Parameter of selection. In the special case in which y» acts as a parameter 


of selection for {f,(x)}, the following theorem gives explicitly an f-sufficient 
statistic. 


THEOREM 2. Jf u acts as a parameter of selection for {f,(x)} then the ‘statistic of 
selection’ is the minimal f-sufficient statistic for {f,(x)}. 
Proor. Since y is a parameter of selection, f,(z) has the form 


f(x) = os,(x)f(x)g(u) 
¥V(T, S,)f(x)g(u). 


Hence T is f-sufficient. By Theorem 1, 7 is minimal f-sufficient for {f,(x)}. 


7. Real-valued parameter. We now consider f-sufficiency when the parameter 
is real-valued and is a parameter of selection. 

THEOREM 3. Jf u is a parameter of selection for {f,(x)}, {S,} are Borel sets and 
ordered by ©, and S, can be put in monotone 1-1 correspondence with a subset of 
R’, then there exists a real-valued statistic which is sufficient and minimal f-sufficient 
for {f,(x)}. 

Proor. By Theorem 2 the statistic of selection is minimal f-sufficient, hence 
we want a real valued statistic 7* which can be put into 1-1 correspondence 
with the statistic of selection. First we define a real valued parameter essentially 
equivalent to uy. 

By hypothesis we can choose @(u) ¢ R' such that S, C Sy <— @(u’) S 0(u’’) 
and S, = Sy < 6(u’) = 6(u’"). Since yw is a parameter of selection, an equiva- 
lent parameter is S, and as is seen above @ is equivalent to S, . Hence we use the 
parameter @ to index the densities. 


We define T*(z) € R’ as follows: 


T*(x) = inf @ for all @ having z e Se. 
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Therefore 
T*(<) = inf @ for all 6 having T, C S,. 
Thus 7* is a function of 7. If T* is also f-sufficient then it can be put into 1-1 
correspondence with 7 and is minimal f-sufficient. Define ¥*(7T*, 6) by 
y*(T*, 0) 1 if T* < 6, 
0 if T* > 0. 
We now prove ¥*(7*(z), 6) = ¥(T(x), Sp). 
¥*(T*(x), 0) = 1 
is equivalent to 
T*(x) = 8, 
which is equivalent to 
T(x) (Se, 
that is, 
W(T (x), Se) = 1. 
Hence 
¥*(T*(x), 0) = ¥(T (x), So). 
The densities f,(z) have the following form: 
F(z) = os,(x)-f(x)-9(8) 
= (T(z), Se) -f(x)-9(9) 
= ¥*(T*(x), 6)-f(x)-g(8). 


Therefore 7*(x) is f-sufficient and hence by previous argument is minimal f- 
sufficient. A more direct proof of this statement could have been made by estab- 
lishing the 1-1 correspondence, but the above functional form for f,(x) is de- 
sirable for the remainder of the proof. 

To prove that 7*(x) is sufficient we need only verify that the conditions of 
Lemma 4 are fulfilled for the set of densities {f,(2)}. Since the sets S, are Borel 
sets, 7*(x) is a measurable function. Also y*(7*, @) is a measurable function 
of T*, and f,(x) is integrable. We now verify that f(x) or a modification of f(x) 
is integrable over US, . Take a monotone sequence {@,;} such that S,, — US,. 
Let 


/ f(x) dX(z) = ae. 
6, 


Choose r(@,;) > 0 such that 
[ f(z) r(x) = 4a, 


3¢,—Se, r(6;) 
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and similarly 





; f(x) oft 
dx(x) = ¢@/2. 
oie, ria) - ‘a 
Define 
r(T*) = 1 if T* sh, 
=r7(6) if A&<T* Sb, 
= r(6;) if 0; < : fs = 6541 . 
Then 
f (x) a a ty 
[ 1 aT ON) = Pell — (2)'h 
Therefore 
f(x) a 
* r(T*) dx(z) = 206 


Therefore the modification of f(x), that is, f(x)/r(T*), is integrable over US, . 
The theorem follows by noting that the modification does not affect the factori- 
zation needed for sufficiency: 


) = ¥*(T* an 1% . f (x) 
fu(z) = y*(T*(z), 6) +g(6) -r(T*(z)) HT) * 

8. Examples. 

EXAMPLE 1. Consider the class of all uniform distributions on R' having range 
1. Let the parameter 6 be the midpoint of the range. For a sample of n from a 
distribution of this family, we look for a sufficient statistic. 

The parameter # is a parameter of selection. Hence the statistic of selection T 
is f-sufficient. T is the nth power of the interval obtained from the intersection 
of all the unit intervals which contain the n points. It is equivalent to the closed 
interval [xz, , x¢| where x, and 2g are respectively the least and greatest values 
in the sample. Thus z, and 2g are jointly f-sufficient for 6. It is easy to verify 
that the conditions of Lemma 4 are fulfilled and hence x, and zg¢ are jointly 
sufficient for @. 

EXAMPLE 2. To a Poisson variable with fixed mean is added an “error” uni- 
formly distributed between —yu and +y where » < }. Let uw be the unknown 
parameter. For a sample of n from this distribution, we look for a sufficient 
statistic. 

This class of distributions satisfies the hypothesis of Theorem 3. Therefore a 
real valued sufficient statistic T exists. T is equal to the largest deviation for the 
n sample values: the deviation for x; is defined to be the absolute value of the 
distance from z; to the nearest integer. 
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If we let (x;) be the integer nearest the sample element 2; , then 


T = Pp | a — (2) |. 

EXAMPLE 3. To a Poisson variable with parameter m is added an “error” uni- 
formly distributed between —yu and +y, where un < 4. Let (m, uw) be the un- 
known parameter. For a sample of n, we find the minimal f-sufficient statistic 
and then check for sufficiency. 

The statistic of selection 7 is as calculated in Example 2. (We only consider 
points in R' for which the coordinates are all > — 4). The carrier of the dis- 
tribution S, can be defined by 


S, = [{z||2— @)| < af] 


Therefore 


Sum (Z) = os, (Z)- n(y) 0s. 


La 
We wish to define f,,(Z) to facilitate the calculation of the minimal f-sufficient 
statistic and yet consistent with the functional form prescribed in Theorem 1. 
The obvious definition fulfills the necessary conditions: 
n (x4) 
’ m ane 
im = - € . 
In ( ) t= (x)! 
The minimal f-sufficient statistic for {f,,m(x)} is >-(a,). 
By Theorem 1 the minimal f-sufficient statistic for {f,,m(x)} is 


| sup |r — (x) |, p> (x) |. 


Since the conditions of Lemma 4 are easily seen to be fulfilled, the above statistic 
is also sufficient. 
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ORTHOGONAL ARRAYS OF INDEX UNITY’ 
By K. A. Busu 


University of North Carolina and University of Illinois 


Summary. In this paper we shall proceed to generalize the notion of a set of 
orthogonal Latin squares, and we term this extension an orthogonal array of 
index unity. In Section 2 we secure bounds for the number of constraints which 
are the counterpart of the familiar theorem which states that the number of 
mutually orthogonal Latin squares of side s is bounded above by s — 1. Curi- 
ously, our bound depends upon whether s is odd or even. In Section 3 we give a 
method of constructing these arrays by considering a class of polynomials with 
coefficients in the finite Galois field GF(s), where s is a prime or a power of a 
prime. In the concluding section we give a brief discussion of designs based on 
these arrays. 


1. Introduction. Let a set of s integers 0, 1, --- ,s — 1 be arranged in ans X s 
square in such a way that every integer occurs s times. If each integer occurs 
once and only once in every row and column, the square is said to be a Latin 
square of side s. Two squares are said to be orthogonal to one another if, when 
one square is superimposed upon the other square, every number of the first 
occurs once and only once with every number of the second square. To the 
set of at most s — 1 Latin squares which are mutually orthogonal, we may 
adjoin two other squares which are not Latin squares but which are orthogonal 
to each other and to every other Latin square in the orthogonal set. The first 
of these squares is constructed by taking each element of the first row as 0, each 
element of the second row as 1, and so on. The second square is the transpose of 
the first square. Conversely it may be noted that any square orthogonal to these 
two squares must be a Latin square. Thus a total of s + 1 orthogonal squares is 
possible at best, and it is known that this bound is attainable when s is a prime 
or a power of a prime [1]. When this bound is attained, we say that we have a 
complete set of orthogonal squares. As an example of a complete set, we might 
choose s = 3 and write 


0 0 0 i ae 012 012 
r 4 3 So 22 i290 20 1 
S22 @ 0. 1 2 20 1 12.9 


If we write in order the elements of each square in a line, we can display these 
squares in the following form: 


ee 6.12 423.22 [first square] 
ei 2-e t 28 3a [second square] 
1 This note is a revision of one part of the author’s doctoral dissertation submitted to 
the University of North Carolina at Chapel Hill. 
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1 [third square] 
0 [fourth square] 


0 1 2 0 0 
os o 2-3 3 
In this form we see that any two rows have the property that each one of the 
nine possible ordered pairs occurs exactly once when one row is superimposed 
on another row. We now generalize this basic idea. 

Let us consider a matrix A = [a;;], where each a,;; represents one of the 
integers 0, 1, --- , 8 — 1, 8s > 1. Th matrix is rectangular with N columns, 
which we shall call the blocks of the array, and k rows. Consider all t-rowed 
submatrices of N columns which can be formed from this array, ¢ S k. Each 
column of any ¢-rowed submatrix can be regarded as an ordered ¢t-plet so that 
each t-rowed submatrix contains N such ¢-plets. The matrix A will be called 
an orthogonal array [N, k, s, ¢] of size N, k constraints, s levels, strength t and 
index » if each of the C% t-rowed N-columned submatrices that may be formed 
from the array contains every one of the s‘ possible ordered ¢-plets each repeated 
\ times. It is clear that this definition implies that each row contains the s 
integers 0, 1, --- , s — 1, each repeated \s*~ times. We shall consider the case 
where \ = 1 and refer to such arrays as “orthogonal arrays of index unity.” 
We shall consider arrays where ¢ > 2 since the case t = 2 has been completely 
discussed and solved for s a prime or a power of prime. References [1], [2], [7], 
[8], and [11] discuss this problem. 


2. Upper bounds for the number of constraints. We shall use the notation 
f(N, 8, 0) to denote the maximum number of constraints which are possible. 
Thus f(N, s, 2) = s + 1 when s is a prime or a power of a prime. We prove 
first the 

Tueoreo. If s < t, then f(s‘, s,t) S$ t+ 1. 

Proor. We shall make repeated use of the following fact: selecting any 
t — 1 rows, any specified (¢ — 1)-plet must occur exactly s times, for these s 
identical (¢ — 1)-plets may be enlarged to t-plets by the adjunction of another 
row in exactly s ways since a given f-plet occurs once and only once. If possible 
let there exist ¢ + 2 orthogonal rows. In order to facilitate notation we shall 
assume that one of the blocks consists entirely of zeros. This is justified because 
within each row we can always make a permutation of the elements 
0, 1,2, --- ,s — 1 without destroying the orthogonality of the array. The general 
case proceeds along slightly different lines from the special cases s = 2 and 
s = 3 which we shall consider first. 

Proof for the case s = 2. We divide the array into two parts. The first part, 
A, consists of three rows, and the second part, B, consists of tf — 1 rows. There 
will be exactly two blocks which will have zero in every row of B. One of these 
blocks is our initial block consisting exclusively of zeros. In the second block the 
three rows of A must contain the symbol 1, for otherwise there would be two 
identical t-plets. Now there will be two blocks which will have the symbol 1 
in the first row of B and zero in all other rows. Let these be the third and fourth 
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blocks. The first four blocks of the array we have just described wil! have the 
form: 


01 
A 01 
+ eo ae 
0011 
2 000 0 
0000 


The third block already has ¢ — 2 elements in common with each of the first 
two blocks. Therefore it can have at the most one more element in common 
with any of these blocks. Since the three rows of A for the third block have to 
be filled in by using the symbols 0 and 1 only, we cannot avoid the situation in 
which it has at least two elements in part A in common with one of the first 
two blocks. The theorem is thus proved for the case s = 2. 

We now proceed to the case s = 3 using the same general type of argument 
although there are more complications. We divide the array into two parts as 
before, three rows in A and ¢ — 1 rows in B. In this case the first fifteen blocks 
of the array can be written as follows: 


0 0 0 0 0 

A 0 0 a 0 0 
0 0 0 0 0 
00 0 ee 22 2 0 0 00 0 

. 00 0 00 0 000 ee a 222 
000 000 000 000 000 


The blank spaces in A are to be filled in with 1 or 2. Obviously with each group 
of three blocks with identical (¢ — 1)-plets in B, we must include 0 from each 
row of A, and two 0’s may not occur in the same block since then a ¢-plet identical 
with a ¢-plet from the first block would arise. We will encounter a somewhat 
similar type of arrangement in the general case shortly to be discussed. Each 
row of B in the portion of the array exhibited contains only zeros with the 
exception of the first two rows. 

Let us consider the four blocks in the array which have 0 in the top line of A 
not counting the initial block. We now attempt to complete the second and 
third rows of A for these four blocks. We note that these four blocks already 
have a common element in A so that if two of the four blocks were completed 
using the same pair we would have two identical triplets in A. However any 
two blocks have at least ¢ — 3 0’s in common in B so that two identical ¢-plets 
would eventuate. Therefore the four pairs must be distinct. From the elements 
1 and 2 we can make only four distinct ordered pairs so that each possible pair 
must be utilized in these four blocks. 

In completing the second and third blocks we must therefore repeat these 
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pairs. Hence we can find two blocks with two elements in common in A. But 
this is impossible since (say) the second block has t — 2 0’s in common with 
every other block in the B portion. 

Proof for the case s > 3. We shall use the same notations and procedures 
employed in the proof of the previous cases. We shall have an initial block 
consisting of t + 2 zeros. We divide the array into an A group with three rows 
and a B group with ¢ — 1 rows. We then write down the s — 1 blocks which 
contain only 0’s in the rows of B. We shall call this group of blocks F. We follow 
this with a group of s blocks which have the element 1 in the top row of B and 
the element 0 in the remaining rows of B. This is followed by a group of s blocks 
containing the element 2 in the top row of B, 0’s elsewhere. Finally we ‘arrive 
at a group of blocks which have the element s — 1 in the top row with 0’s else- 
where. We have now secured s — 1 groups with s blocks in a group in addition 
to the group F. We now generate s — 1 further groups each containing s blocks 
by choosing the second row of B as our non-zero row. Proceeding in this way 
we finally obtain (t — 1)(s — 1) groups each containing s blocks since there are 
t — 1 rows in B. 

Consider one of these groups other than F which have identical (¢ — 1)-plets 
in B. Over such a group the rows of A must contain some permutation of the 
elements 0, 1, --- , s — 1 in order that no ¢-plet be repeated. Hence the element 
0 must occur once in each row of A over such a group; further, it must not occur 
twice in the same block, for then a ¢-plet consisting exclusively of 0’s would 
arise. There are thus (s — 3)(t — 1)(s — 1) blocks in these groups (exclusive 
of F) which contain no element 0 in the three rows of A. 

Over every row of A each of the elements 1, 2, --- , s — 1 occurs once in 
each group. If this condition is not met, then we either lose a ¢-plet or we secure 
more than one ¢-plet since in B each group exhausts a given (¢ — 1)-plet. Let us 
denote by e that element which occurs most frequently in the first row of A in 
those blocks which do not contain the element 0 and are not in F. Then e occurs 
in these blocks at least (s — 3)(¢ — 1) times, for this is the number of blocks 
averaged over the number of elements, and there are s — 1 nonzero elements. 

The element e will also occur in some block of F in the first row of A. Suppose 
that in this block the elements a and b occur in the second and third row. Now 
no element in the second row of A can be the element a if the same block contains 
the element e in its first row, for then we would have two elements in common 
in A, and any block in F has t — 2 elements in common with any other block 
in B; this would yield two identical t-plets. A similar remark applies to the 
element b in the third row of A. Since we are considering only those blocks not 
in F which contain no zero in any row of A, we may therefore form but (s — 2)’ 
pairs when the element e occurs in such a block. 

However, the pairs in these blocks must all be distinct. If they were not, 
then we would have three elements in common in A, and always there are 
t — 3 zeros in common in B so that again two ¢-plets would be identical. Further- 
more, none of these pairs in the second and third rows may coincide with a pair 
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in the second and third row of F by a like argument, that is, two elements alike 
in A, t — 2 elements alike in B. There are s — 2 pairs which remain in F since 
we must obviously exclude the pair (a, b) for which we have made a stronger 


statement. Now there are at least (s — 3)(¢ — 1) distinct pairs not in F so that 
we must have 


(s — 2)’ = (s — 2) + (s — 3)(t — 1), 


for the total number of allowable pairs must not be less than the total number 
of distinct pairs required. Upon simplification we obtain 


(3 - s\(t¢-s+1) 20, 


which is a contradiction. This proves our theorem for s > 3. 

We now prove a special result for the case ¢ = 3. In the proof we require the 
following definition. 

Deriition. Two blocks will be called disjoint if corresponding elements are 
different, that is, a;; * a for each value of 1. 

TuroreM. When s is odd, f(s°, s, 3) S s + 1. 

Proor. Suppose that s + 2 orthogonal rows can be constructed. Now each 
element is repeated s’ times in each row and each pair of elements occurs s 
times in any two rows. Consider the elements in the first block, and let us select 
a particular element in this block. With the other elements in the block we can 
form s + 1 pairs where the particular element selected is used as one component 
of the pairs. Taking into account the fact that each of these pairs occurs once 
in the initial block and that we have also here used one replication of our selected 
element, we have to form pairs in other blocks containing the element selected 
(s + 1)(s — 1) times. But this exhausts the replications of the element chosen. 
Consequently any two blocks have either two elements in common or are dis- 
joint. From the s + 2 elements in the initial block we can form (s + 2)(s + 1)/2 
pairs which are repeated s — 1 times. But 


(s + 2)(s + 1)(s — 1)/2 <8 —1, s>1, 


so that disjoint blocks exist. Let us consider two disjoint blocks, and all other 
blocks (s — 1) in number which contain the same pair in the first two rows as 
the second of these disjoint blocks. We can then represent the situation as 


ay by by by ° by 
a2 be be be e be 
a3 bs 
a4 bs 
Qs+2 be+2 
where a; ¥ b;,7 = 1, 2, --- , s + 2. Since every triplet occurs exactly once, 


then the last s elements in the last s rows of the first block must occur exactly 
once in these s — 1 blocks. But since two blocks have either none or two elements 
in common, we get a contradiction since s is odd. 
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We are now in a position to state the general theorem. 

THEOREM. The maximum number of constraints is bounded above by s + t — 1 
if t S s and s is even. In case s is odd, we may refine the inequality to s + t — 2 
when3 Sts. 

Proor. This theorem is an immediate consequence of the preceding theorem, 
for the existence of an array with k + 1 constraints and strength ¢ implies the 
existence of an array with k constraints of strength ¢ — 1 since we may select 
a particular row in the first array and consider the s*" blocks which have 0 as 
the element in that row. Evidently the k rows which remain form an or- 
thogonal array of strength t — 1, for each (t¢ — 1)-plet occurs exactly one time; 
otherwise with 0 as a common element some ¢-plet would occur more than once 
in the first array. Hence increasing ¢ by one can increase the number of con- 
straints at most by one. 

The inequality given above represents a substantial improvement over a 
similar inequality due to Rao [8]. Rao’s result states that the number of con- 
straints k is bounded above by 


t 


s' — 1 = Ci(s — 1) + --- + Crs — 1)" if ¢ = 2u, 
s'—12Cis—1)+--- +CK(s—1)*+Co(s— 1°" = ift = Qu +1. 


When ¢ = 3, the Rao bound is s + 2, so that we have reduced the bound by 
unity if s is odd. When ¢t = 4 and s = 2, the Rao bound is 5, agreeing with our 
result. When s = 3 and ¢ = 4, the bound is 6 against our 5; when s = 4 and 
t = 4, the bound is 7 against our 5; when s = 5 and ¢ = 4, we have 9 against 7. 
The differential tends to increase both with increasing s and increasing t. Thus 
when t = 6 and s = 11, the Rao bound is 22 against our 15. 


3. Construction of orthogonal arrays of index unity. We now prove the following 
theorem which, in conjunction with a corollary, provides a complete answer to 
the problem of construction of orthogonal arrays of index unity and strength 
three when s is a prime or a power of a prime. 

Tuerorem. If s = p", where p is a prime and s > t, then we can construct the 
array (s‘, s + 1, s, 2). 

Proor. Let GF(s) denote the finite Galois field with s = p” elements which 
may be denoted by e; , 7 = 0,1, --- , s — 1. Consider the polynomials 


yz) = aay) + apg’? +--- + arta, 


where the coefficients range over the field GF(s). It is clear that there are s‘ 
such polynomials, since each of the ¢ coefficients can assume s different values 
in the field, and the subscript 7 ranges over the values 0, 1, --- , s' — 1. We 
now form an s by s‘ array numbering the rows from 0 to s — 1 and the columns 
from 0 to s‘ — 1. In the 7th row and jth column we agree to insert the integer u 
with the property 

yj(e;) = eu. 


We assert that the resulting array is orthogonal of strength ¢ and index unity. 
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Suppose on the contrary that we can select ¢ rows such that two ¢-plets are 
identical, and let the associated polynomials be 


(1) 6.12" + Gor” + ahha + Oe + = y;(z), 
ayat* + ayer’? + +++ faz + ay = yy(z). 


Let the rows be those rows which correspond to the Galois field elements 


€i,, Cig, *** » @x,- Upon inserting the element e;, in equations (1) above and 
subtracting these two equations, we have 


Aviei, + Aveeix, + +++ + Arex, + Ao = 0, 


, 
where A, = a, — a, . As we allow r to range from 1 to ¢, we secure ¢ homoge- 


neous equations linear in the ¢ quantities Ay1, Ar», --- , A1, Ao. Not all the 
A’s can be zero, since then the two polynomials would be identical. Consequently 
for a solution to exist the determinant of the matrix V, where 


t—1 t-2 
Ci, 6; coe @& «(1 


t—1 t—2 


i 6 -<* a 4 
V = . . - 
. . ? 


t-1 t—2 
C4, Ck, eee Cie 


— 


must vanish. However, it is well known that this matrix of Vandermonde type 
has the property 


det [V] = I] (e:, — «,), 


u<v 


and so is nonsingular unless e;, = e;,, which is clearly impossible since the 
rows were all distinct. 

We have thus shown that all é-plets are distinct, and this completes the 
demonstration that we can construct s rows. However, we can adjoin one more 
row in an orthogonal manner by assigning the value u to those columns which 
are associated with the polynomial whose leading coefficient is e, . In this case 
A, = 0, and we have ¢ — 1 equations in ¢ — 1 unknowns. Here for a solution 
to exist we must demand that the Vandermonde determinant of order t — 2 


vanish, and this is impossible. (We use order to indicate the highest degree of 
terms in the matrix.) 
For the special case ¢ = 


3, it is possible to add yet another orthogonal row 
when s = 


2” by assigning the value u to those columns which have e, as the 
coefficient of the term of degree t — 2. It is clear that any ¢-plet which is con- 
structed by using two components from these two rows and ¢ — 2 components 
from the original s rows occurs just once. Here both A;; and A;_» vanish, and 
we have a nonvanishing determinant of Vandermonde type of order t — 3. 

On the other hand, if our ¢-plet includes only the final row, the resultant 


matrix is no longer of Vandermonde type and may be singular. This cannot 
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happen over fields of characteristic 2 when ¢ = 3, for we obtain the matrix: 


ei, 1 

ey 1s’ 
The determinant of the matrix is (e;, — e;,)(e:, + e:,), and since every element 
is its own additive inverse in fields of characteristic 2, it is clear that the matrix 


is nonsingular. We may therefore state the 
Corotiary. For the array (s*, k, s = p", 3), where p is a prime, we have 
f(s, 8,3) =s+1,8s =p’, p an odd prime, 
f(s, 8,3) = 8 + 2,8 = 2", 
by virtue of this construction and the inequalities of Section 2. 

Tueorem. If s < t, f(s‘, s, t) = t + 1, where s = p”", p a prime. 

Proor. In Section 2, we showed that for this case f(s‘, s, ) < t + 1. We now 
show that this bound is attainable by using the same constructive procedure 
employed in securing the additional rows in the last case we discussed. For 
example, the third row will have the integer u in every column which has e, 
as the coefficient of the term of degree t — 3. In this way we clearly succeed in 
constructing an array of strength ¢ and index unity which is orthogonal. To this 
array we can add another row by the process we first used where we now substi- 
tute into the various polynomials one of the nonzero elements of the field. For 
convenience we may as well associate the additional row with the unity of our 
field. It is clear that the matrix is nonsingular; indeed, it consists of a single 
nonzero term. 

We may summarize these results when ¢ > 3 as follows: 

(i) Ifs = 2" >¢, thens + 1 S f(s‘',s,t) Ss +it—1. 

(ii) If s = p" > t, where p is an odd prime, then s + 1 S f(s‘, s, 2) S 
s+it— 2. 


4. Uses of orthogonal arrays. A problem which often arises in the design of 
an experiment is that of ascertaining the effect of quantitative or qualitative 
alterations in the various components upon some measurable characteristic of 
the complete assembly. The traditional case is that of k fertilizers each of which 
can be applied at s different levels. To carry out a complete factorial experiment 
would require s* plots or assemblies to use a more general term applicable to any 
type of experiment, agronomic or otherwise. 

Rao [8] has shown that if the design is an array of strength ¢, then the estimates 
of main effects and interactions are unaffected by interactions of order greater 
than one and less than ¢ — 1, but the estimate of error is enhanced by their 
presence. If ¢ is even, we can measure interactions up to order ¢/2 supposing 
the higher order interactions absent. When ¢ is odd, we can measure interactions 
up to order (¢ — 1)/2. Thus an array of appropriate strength must be chosen 
to handle those interactions which are deemed important, but it will not in 
general be necessary to construct an array of size s*. 
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DISTRIBUTION TABLE FOR THE DEVIATION BETWEEN TWO SAMPLE 
CUMULATIVES' 


By Frank J. Massey, Jr. 
University of Oregon 


Suppose x, < a2 < --: < ty,, 41 < Y2 < *** < yw, are the ordered results 
of two random samples, of sizes N; and N,, taken from two populations with 
cumulative distribution functions F;(x) and F,2(y). 

Let d = max | Sy,(x) — Swy,(x) |, where Sy,(x) is the proportion of the N; 
observed values x; less than or equal to z, and Sy,(x) is the proportion of the 
Nz observed values y; less than or equal to x. If F\(x) = F(x) = F(x) and if F(x) 
is continuous then the distribution of d is independent of F(x). Table 1 lists, 


for N,, Ne S 10, all possible values of d, and @ such that 


P{d < da} =a. 


Table 2 lists certain other selected values of N;, Nz, and d,. 
The method used in finding the values is that described in [1]. 


REFERENCE 


{1] Frank J. Massey, Jr., ‘‘The distribution of the maximum deviation between two 
sample cumulative step functions,’’ Annals of Math. Stat., Vol. 22 (1951), pp. 
125-128. 


1The method of computing the values tabled was developed under contract N6-onr- 
218/IV with the Office of Naval Research (see [1]). The main part of the table was made 
possible by a grant from the Graduate School of the University of Oregon. 
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Values of a and d, such that for Ni, Na S 10, P {d S d,} = 


FRANK J. MASSEY, JR. 


TABLE 1 


a. Headings are in the form 


(Ni, Na, da) with the d, expressed as a fraction with the least common multiple of N; and 





Nz in the denominator. All possible values of d, are listed in the table. 





(1, 1, 4/1) 















































24 1 


(1, 2, 4/2) (1, 3, 4/3) (1, 4, 4/4) (1, 5, #/S) (1,6, h/6) (1, 7, 4/7) 
sc # a: 7. a h or . a h e A a 
11 1 .33 ss 2: 3 3.33333 3 .14286) 4 .25 
21 31 3 .6 | 4 .66667/ 4 .42857| 5 .50 
41 | 51 5 .71429| 6 .75 
6 1 71 
(1, 8, 4/8) (1, 9, 4/9) (1, 10, 4/10) (2, 2, 4/2) (2, 3, 4/6) (2, 4, 4/4) 
. as aie eae - Se. a oe 
. 4 lll) & .2 5 .09091 1 .66667 2 .1 1.06667 
5 .33333 6 «4 6 .27273 21 3.4 2 .60000 
i 6 .55556| 7 .6 7 45455 4 8 3.86667 
; 7 .77778| 8 8 8 .63636 61 41 
81 91 9 .81818 
10 1 
(2, 5, 4/10) (2, 6, 4/6) (2, 7, &/14) | (2, 8, 4/8) (2, 9, 4/18) (2, 10, 4/10) 
h 2 o lk a | h a h s A a - a hate 
3 .04762 | 2 .14286 | 4 .02778| 2 .02222/ 5 .01818| 3 .06061 
4 .19048| 3 .57143| 5 .11111| 3 .20000| 6 .07273 | 4 .24242 
: 5 .42857| 4 .78571| 6 .25000| 4 .55556 | 7 .16364 5 .54545 
6 .71429| 5 .92857| 7 .44444| 5 .73333| 8 .20091 6 .69697 
8 .90476| 61 | 8 .66667| 6 .86667| 9 .45455 7 .81818 
10 1 | | 10 .83333 | 7 .95556 | 10 .63636 8 .90909 
| 12.98 | 81 12 .78182 9 .96970 
| 141 14 .89091 | 10 1 
; | 16 .96364 
: | 18 1 
: (3, 3, 4/3) (3, 4, 4/12) (3, 5, 4/15) (3, 6, 4/6) (3, 7, 4/21) (3, 8, 4/24) (3, 9, 4/9) 
i h - h a fi hk a h a A a A a A a 
; sel ea | = 
j ta 3.02857 4 .03571, 1 .01191 |) 5 .00833 5 .00606 | 2 .03636 
2 9 4 .11429| 5 .14286 | 2 .32143 6 .06667 6 .02424| 3 .29001 
31 5 .34286 | 6 .32143 3 .66667| 7 .15000 7 .07273| 4 .54545 
6 .60000| 7 .53571| 4 .90476| 8 .30000| 8 .16364| 5 .76364 
8 .77143 9 .71429 5 .97619 9 .46667 9 .20091| 6 .90909 
9 .94286| 10 .85714 61 11 .60000 10 .43636 7 .96364 
121 12 .96429 12 .75000 12 .57576 8 .99091 
15 1 14 .83333 13 .69697| 91 
15 .93333 15 .80606 
18 .98333 | 16 .87879 
211 18 .95152 
21 .98788 








(3, 10, 4/30) | (+ 10, B/30) (4, 4, (4, 5, 4/20) (4, 6, h/12) (4, 7, /28) (4 3, Ae) 


a a a h a h a h a A a 


-00350 | 18 .81119 » -03175 2 .00476 .00303 17 .87879 
.01399 20 .83566 2 . -12698 | 3 .07619 5 «6.01212 20 + .93333 
-04196 21 .93007 -97143 4 7 4 .30476 .04848 21 .96970 

9 .09441 | 24 .97203 43651 5 .44762 -10909 24 .99394 

10 .16783 | 27 = .99301 -57143 | 6 .70476 9 .21818 281 

11 .27972 | 30 1 -71429 | 7 .81905 | 10 .33939 

12. .40210 .85714 | 8 .90476 12 .46364 

14 .50699 -92063 9 .95238 13 .58485 

15 .62937 -98413 10 .99048 14 .69091 

17 .71329 ‘ 12 1 16 .78788 


(4,8, 4/8) | (4,9, 4/36) (4, 10, 4/20) (5, 5, &/S) (5, 6, 4/30) (5, 7, 4/35) 


a | a A a 


.00100 5 .00216| 6 .00253 
, 01518 2 6 .00866 7 .01010 
.02238 .08092 | j 7 .03463 8 .04040 
.05035 .22478 | 99: 8 .10390 9 .09091 
.11329 .31269 | 9 .18182 | 10 .16162 
.18881 ; 50050 10 .31169 11 .26263 
. 29231 59041 | 12 .40909 | 13 .36111 
. 38182 .74026 | 13 .52597 | 14 .45455 
48252 .81219 | | 14 .64286 15 .56566 
.59580 .87413 15 .76190 | 16 .67172 
.66434 .91608 | 18 .82251 | 18 .76263 
-74825 .95405 19 .89177 | 20 .83333 
83497 .97003 | 20 .95238 | 21 .88384 
.88531 .99001 | 24 .97403 | 23 .93434 
93846 .99800 | 25 .99567 25 .96970 
.95804 30 1 29 98485 
-98601 30 .99747 
.99720 35 1 


Se ele te ere ae areca 





(5, 10, 4/10) | | (6, 6, &/6) 


6 .00078 
7 .00311 
8 .01243 
9 .03730 | 
10 .08392 
11 .14918 
12 .23077 
14 .31624 
15 .41414 
16 .50039 
17 .59984 
19 68376 


.00033 | 
.08002 

34532 | 
.64935 

.83417 | 
-93939 | 
.98069 | 
.99600 | 
.99933 | 


one 
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TABLE 1—Continued 


























(6,7, 4/42) | STB) | 68,4728) | ORB) | (6,9, w/18) 

| . i 
h a h a A a h a k a 
6 .00058 | 28 .93240 | 3 .00033 | 20 .99467 | 2 .00020 
7 .00233 | 29 .96154 4 .00533 | 21 .99933 | 3 .01279 
8 .00932 | 30 .98485 5 .04795 | 241 | 4 .10230 
9 .03730 | 35 .99126| 6 .14685 | 5 .22058 
10 .07459 | 36 .99883 | 7 .21612 | 6 .43716 
11 .12821 | 42 | 8 = .36264 | 7 .50161 
12 .21970 | 9 .53979 | 8 .72647 
14 .28846 | 10 .62371 | 9 .82418 
15 .37762 | (11 .69830 10 .90529 
16 47203 | 12 .80753 | 11 .93886 
17 .56643 | 13 .86081 12 .97203 
18 .66725 | | 14 .90743 | - 13 .98601 
21 .72261 | 15 .93939 14 .99401 
22 .78788 | 16 .95738 15 .99720 
23 .85315 | 17 .97736 16 .99960 
24 .90909 | | 18 99068 18 1 
(7, 7, h/?) | (7,8, h/soy | S.A) | (7,9, nfs) | (9/63) 
A a A a h a h a h a 
1 .03730 | 7 .00016 | 28 .85859| 8 .00017 | 29 .78234 
2 .42483| 8 .00062 | 32 .88190| 9 .00070 31 .83129 
3.78788 | 9 .00249 | 33 .91298 | 10 .00280 | 33 .87325 
4 .94697 | 10 .00995 | 34 .93629 | 11 .01119 | 35 .90210 
5 .99184 | 11 .02984 | 35 .96737 | 12 .02517 | 36 .92133 
6 .99942 | 12 .05221 | 40 .97576 | 13 .04476 | 38 .94493 
71 | 13 .08951 | 41 .98695 | 14 .07710 | 40 .96591 

14 .15338 | 42 .99534 | 15 .12483 | 42 .97902 

| 16 .18943 | 48 .99751 | 17 .17238 | 45 .98514 

| 17 .26434 | 49 .99969 | 18 .22500 | 47 .99248 

18 .33986 | 56 1 19 .28636 49 .99720 

19 .41538 20 .35245 55 .99860 

20 .49231 21 .42727 | 56 .99983 

21 .57824 22 .50122 63 1 

24 .62720 23 .56976 

25 .65703 26 .63199 

26 .71795 | 27 .67622 

27 .77762 28 .72990 





(6, 10, 4/30) 
kh a 

4 .00050 
5.00799 | 
6 .04046 | 
7 .11239 
8 .16459 | 
9 .28746 
10 .42258 
11 .49451 
12 .62887 
13. .69505 
14. .75125 
15 .82992 
16 .87488 
17 .90784 
18 .93357 
19 .95804 | 
7, 10, 4/70) 
h 





10 
11 
12 
13 
14 
15 
16 
18 
19 


21 
22 
23 
25 
26 
28 





(6, 10, 4/30) 


(cont.) 

A a 
20 .96853 
21 = .98102 
22 = =.99101 
24 .99600 
25 .99825 
27 «=.99975 
30 1 

(7, 10, 4/70) 





(cont.) 


DEVIATION BETWEEN TWO CUMULATIVES 


TABLE 1—Concluded 


(8, 9, 4/72) (8, 9, 4/72) (8, 10, 4/40) (8, 10, 4/40) 
(comt.) (8, 10, 4/40) ) (cont.) 


a a a 





.01989 | 8 . 35985 : d 18 .79633 
.33986 | 9 .00016 42390 ‘ -00585 83404 
-71733 | 10 .00066 .49720 46 . .02340 | 20 .87975 
-91298 | 11 .00263 .53970 : 06913 -90123 
.98135 | 12 .01053 59301 : 10176 -92317 
-99751 | 13 .02106 -64829 : 17729 -95014 
-99985 | 14 .03620 . 70358 . -27725 .96270 
15 .06203 75755 ‘ 39760 -96974 

16 .10629 80424 : -45775 97934 

13957 -82682 : -51469 -98798 

19 .18326 -85767 -60825 -99301 

-89058 67045 -99502 

21 = 120 -92143 - 75246 -99758 


onourwhnd- 


rr" 


(9, 10, k/90) { (9, 10, 4/90) (9, 10, 4/90) , 
9, (cont.) (cont.) (comt.) (10, 10, 4/10) 


@ a A a A a 


-09616 | 32... : 70 = .99725 -00554 
.12626 | 33. : 71 + .99864 | 2 = .21307 
-16572 | ¢ d ‘ 72 .99959 58248 
. 21307 ‘ ; 80 .99978 .83218 
- 26042 ; on 81 .99998 -94755 
30864 ; ‘ 90 1 -98766 
35336 ‘ ‘ -99794 
42493 é : -99978 
-46141 ‘ é -99999 
-50783 


1 
2 
3 
4 
5 
6 
7 
8 
9 
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TABLE 2 


Values of a and d, such that P {d Ss d.} = a for certain values of Ni, Nz and d,. Head- 
ings are expressed as in Table 1 in the form (N,, N2, da). 














(3, 12, #/12) (4, 12, 4/12) (4, 16, 4/16) (5, 15, 4/15) (5, 20, 4/20) (6, 12, &/12) (6, 18, 4/18) 
h a h a h a A a h a h a A @ 
2 .00220 5 .59560 2 .00021 6 .65738 2 .00002 1 .00005 7 .69767 
3 .059384 | 6 .78462 3 .01672) 7 .79463 3 .00457 > 2 .03927 8 .81794 
4 .27473 | 7 .88791 4 .12900 8 .89048 4 .05882 3 .24036 9 .89899 
5.47473 8 .95165 5 .29164 9 .94814 5.17397 4 .53200 10 .94655 
6 .66154 9 .98352 6 .47864 10 .97665 6 = .33618 5 .74618 11 .97459 
7 .81099 | 10 .99451 7 .65243 | 11 = .99123 7 .50941 6 .88537 12 .98908 
8 .91209 | 11 .99890 8 .78947 12 .99729 8 .66319 7 .95367 13 .99563 
9 .95604 9 .87203 | 13 .99923 9 .77216| 8 .98513 
10 .98242 10 .92983 10 .85590 | 9 .99591 
11 .99560 ll .96615 11 .91519 10 .99925 
12 .98555 12 .95306 11 .99989 
13 .99381 13. _.97470 
14. .99794 14. .98769 
15 .99959 15 .99466 
16 .99789 
17 .99921 
18 .99977 
(6, 24, h/24) (7, 14, 4/14) | (7, 28, 4/28) | (8,12, 4/24) | (8,16, 4/16) | (8, 32, 4/32) | (9, 12, 4/36) 
A a A a h a | bk a A a A @ h @ 
3 .00123 | 2 .01881 3 .00033 7 .40465, 2 .00892 3 .00009 | 12 .57284 
4 .02632 | 3 .16511 4 .01162 8 .55223 3 .11232| 4 .00508 | 13 .65542 
5.10183 4 .43014 5 .05882 9 .67596 4 .34442 5 .03364 14 .70465 
6 .23167 | 5 .65870| 6 .15755 | 10 .78579 | 5 .57501 6 .10610 15 .79433 
7 .39022 6 .82383 7 .29497 | 11 .85044 6 .76578 7 .22079 16 = .84105 
8 .54651 7 .91730 8 .44440| 12 .90933 7 .87443 8 .35783 | 17 .88617 
9 .67067 8 .96687 9 .57474 | 13 .94434 8 .94207 9 .48770 18 .92151 
10 .77301 9 .98822 | 10 .68883 | 14. .96801 9 .97576 10 .60778 19 .93937 
11 .85137 10 .99661 11 .78160 | 15 .98179 10 .99124 11 .71051 20 .95856 
12 .90678 | 11 .99917 | 12 .85191 | 16 .99138 11 .99720 | 12 .79265 21 .97396 
13 .94311 | 12 .99986 | 13 .90208 | 17 .99524 12 .99927 | 13 .85487 | 22 .98204 
14 .96738 | 13 .99998 | 14. .93811 | 18 .99802 | 13 .99984 | 14 .90198 _ 23 .98803 
15 .98242 15 .96254 | 19 .99913 14 .99998 | 15 .93600 | 24 .99281 
16 .99101 16 .97818 | 20 .99968 15 1.00000 16 .95948 25 .99538 
17 .99562 17. .98775 | 21 .99986 | 16 1.00000 | 17. .97512 26 .99752 
18 .99806 18 .99351 18 .98534 | 27 .99857 
19 .99923 19 .99675 19 .99170 28 .99901 
20 = .99972 20 .99846 20 .99547 29 .99956 
ac 





DEVIATION BETWEEN TWO CUMULATIVES 


TABLE 2—Concluded 


9, 15, 4/45) (9, 18, &/18) (9, 36, &/36) (10, 15, 4/30) (10, 20, 4/20) | (10, 40, 4/40) 


(12, 15, 4/60) 


e 


a a a h a kh a a a 


000022 8. -00020 -00001 
00220, 9 . -05090 -00095 
-01910 10 
.07091 | 11 . -43090 
-16403 12 
-28596 | 13 
41073 14 
.53221 | 15 
22 = .92671 -64099 | 16 

-94103 -73196 | 17 


14 .51355 .00420 | 3 
4 
5 
6 
7 
8 
9 
10 
ll 
| 12 
.95820 ‘ | 13 80416 | 18 
| 14 
15 
16 
17 
18 
19 
20 


15 .60637 
16 .67583 
17 .73473 -49960 
18 .78605 
19 .83420 
20 .86713 
21 = =.89937 


- 76664 








ey 


-97027 -86114 | 19 
-97769 -90427 | 20 
-98515 -93569 | 21 
-98962 -95790 
-99272 97333 
-99448 - 98362 
-99637 -99024 
-99731 

-99799 

- 99864 


weer 
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ene ae ae ee 


(12, 16, 4/48) (12, 18, 4/36) (12, 20, 4/60) (15, 20, 4/60) (16, 20, 4/80) 


er 


A a h a A a 
-74728 
. 78477 
.81939 
.84849 
.87017 
.89148 
-91112 
-92759 
-94026 | 
95111 
. 96069 
.96864 
.97489 | 
. 98032 
.98458 
.98790 | 


14 .53765; 9 . 16 . 16 .56529 | 
15 .63564 10 . 7. 17 .63688 | 
16 .70027 11 . (48. 18 70099 | 
17 .76201 | 12 . w . 19 
18 .81604/ 13 . | 20 . 20 
19 .85183 14 . (21 .78375 21 = .83880 
20 .88682 15 . 3 22 
21 .91630 16 . 23. 23 
22 .93670 17 . oe 24 
23 95309 18. | 25 . 25 
.96637 19 . 2% 26 
.97573 | 20 .99029 | 27 . 27 
.98335 21 .99429 28 
.98848 29 
.99190 30 
.99423 
.99624 
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THE STOCHASTIC INDEPENDENCE OF SYMMETRIC AND 
HOMOGENEOUS LINEAR AND QUADRATIC STATISTICS 


By Evcene Luxacs 
National Bureau of Standards 


1. Summary. The following theorem is proved. If a univariate distribution has 
moments of first and second order and admits a homogeneous and symmetric quad- 
ratic statistic Q which is independently distributed of the mean of a sample of n 
drawn from this distribution, then it is either the normal distribution (Q is then 
proportional to the variance) or the degenerate distribution (in this case no re- 
striction is imposed on Q) or a step function with two symmetrically located steps 
(in this case Q is the sum of the squared observations). The converse of this state- 
ment is also true. 


2. Introduction. It is known that the distributions of the mean and of the 
variance in samples from a continuous population are stochastically independent 
if and only if the parent distribution is normal. This theorem was proven inde- 
pendently by several authors [1], [2], [3]. 

The question arises whether there are any distributions having the property 
that the sampling distributions of the mean and of a symmetric and homogeneous 
quadratic statistic are stochastically independent. This is the problem to be dis- 
cussed in the present paper; all distributions with this property will be deter- 
mined and also the corresponding quadratic statistics. In this discussion we 
consider a constant as stochastically independent of any random variable. 

In an earlier paper [3], dealing with the independence of the mean and the 
variance, the existence of a frequency function was assumed. To obtain all pos- 
sible distribution functions it is necessary to refrain from this assumption and 
to express the formulae in terms of the cumulative distribution functions. Other- 
wise the derivation of the differential equation of the characteristic function 
(Section 3) resembles the reasoning of the preceding paper. In Section 4 and 
Section 5 this differential equation is discussed and the various possible solutions 
are determined. 


3. The differential equation for the characteristic function. We consider a 
univariate population with a cumulative distribution function F(x). Let 
1, %2,°**,2, be n independent observations of the variate x. The cumula- 
tive distribution function of the sample is then given by ®(1, 22, ---, %n) = 
F(a) F(ae) «++ F(an). Let us set L = 2 sen Es and S = jet 23 . Any symmet- 
ric and homogeneous quadratic statistic Q can then be expressed in terms of L 
and S: 


(1) Q = al’ + BS. 
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The problem under investigation is the determination of all cumulative distribu- 
tion functions F(x) and statistics Q for which the sampling distributions of Q 
and of the mean = DY ruiz,/n (or equivalently of L = n#) are stochastically 
independent. 

The characteristic function of the distribution F(x) is given by 


+o 
(2) $0) = [ e* dF(z). 
The characteristic function of the statistic L is 
+20 +0 n +0 
(3.1) &@ = [ id / e** d0(z, --- 2.) = II [ e* dF(x,) = WO. 


j=l 


Similarily the characteristic function of the statistic Q is given by 


The statistics Q and L are independently distributed if and only if 


, 

. ” bie ; 

(3.2) ¢:(v) = [ ves [ e? d&(x, +++, 2), 
and the characteristic function of the joint distribution of L and Q by 
+0 ee ae 

(3.3) ¢(t, v) = [ vee [ et te db(4,, «+>, Pa). | 
i 


(4) o(t, v) = dilt)de(v). 


A 


Differentiating (4) with respect to v and then putting v = 0 one has 


Oo 
OU | v=o 


3 
ov | wan” 


a4 | 
= g(t) =| _, = wor 


or from (3.1), (3.2) and (3.3) 
+2 +2 { +2 +2 +2 +20 ) 
| it 4 Qe" de =\/ a | ett aa\ [ ies I Q d®> 
+20 +0 
-wor[ -- [ae 


Any distribution function F(x) and any statistic Q which satisfies (4) also 
satisfies condition (5). It is worthwhile to remark that (5) implies certain re- 
strictions on the statistic Q. 

In the following we determine the distributions F(x) and statistics Q which 
satisfy (5). This is done by first transforming (5) into a differential equation for 
the characteristic function ¥(¢) and by finding also a statistic Q using (5). Finally 
we shall investigate which of these distributions and statistics will also satisfy 
condition (4) and constitute hereby a solution to, our problem. 
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We denote the left-hand side of (5) by /(¢). Substituting for Q from (1) we 
obtain after a simple computation 


I(t) = —nly(ol" | (a + b)y(d) dy + a(n — 1) (#) |. 





dt® dt 
, This permits one to reduce (5) to a differential equation for the characteristic 

function 

(6) (a + b) | stn | + a(n — 1) | sin ) = A, 

where 

(6.1) A = —[(a + b)ao + (n — laa’, 

{ with the initial conditions 
. (6.2) y(0O) = 1; V’(0) = tm. 
Here 


+20 
a, = | x dF(z). 


From (6) and (6.2) we obtain easily first an equation for the cumulant gener- 


ating function g(t) = In Y(t) and then the following differential equation for 
dg 
h(i) = +: 
Ul) dt e 
i dh 3 
(7) (a + b) = + (na + b)[A()) = A, 
; ( 
1 with 
i 
} (7.1) h(O) = ia. 
! 


4. Discussion of the differential equation (7) if A ~ 0. We have to distinguish 
three possibilities: 


ee 


eens P A 
oil nanan en mentee ee 
GE voce RC A A AEA: 


i ; (8.1) A #0, na +b = 0, a+b #0; 
, # (8.2) A¥0, nat+b+¥0, at+b#0; 
(8.3) A¥0, na+b¥0, at+b=0. 
We first discuss case (8.1); equation (7) reduces to (a + b)dh/dt = A; from 
(6.1) and na + b = 0 it follows that 
S =—¢ = —(a, — ai). 


Integrating this equation and considering that h(t) = dg/dt we obtain using the 
initial condition (7.1), g(t) = —4}o°t + iat. This is the cumulant generating 
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function of the normal distribution. Since b = —na we find Q = —an’s’. Here 
gs = Zhe x;/n — (> f.12z,)*/n’. In case (8.1) the parent distribution is normal 


and the statistic Q is—except for a constant factor—the sample variance. Con- 
versely it is known that for the normal distribution variance and mean are 
stochastically independent. 

We start the discussion of case (8.2) with the almost trivial case when A(t) 
reduces to a constant, and delay dealing with the general case. If A(t) is a constant 


and if (8.2) holds then equation (7) is satisfied if h(t) = A/(na + b) = const. 
Then A(t) = h(O) = ta, , and since dg/dt = h(t), g(0) = 0 we obtain g(t) = 
iat and y(t) = e'*''. The function y(t) = e'*“ is the characteristic function of 


the degenerate distribution 
ite , fl if : 
r— a) = . 
; \o if ¥ 
It is easy to show that for this distribution any symmetric and homogeneous 
quadratic statistic is independent of the mean. 
We proceed with the discussion of case (8.2) by assuming that 
2 A 
(9) h(t) # ——. 
na + b 


Equation (7) may then be written as 


g+neu E »_ bro |, 
dt A 





We integrate this equation and then compute the function ¥(¢) from the relation 
h(t) = dg/dt = d/dt \n y(t), with YO) = 1. 
Thus we obtain 


(10) v(t) = [pe + ge), 
with 
ws “+>. incghtauaaieas q=.- mie 
na+ b c+ 1 C+ 1 
2 A pe ee 
(10.1) B= x / in Vir - lai — Aan, 
a AB + Zia 


Ag 7F Zia 


In these formulae a and b and therefore also A, 8, C as well as \, p and q may 
be functions of n. 


In the following we have to distinguish two cases. We first assume that 
(8.2.1) hag > (A — lai. 


Then 8 is purely imaginary so that C, p and q are real numbers. Since p + qg = 
1, at least one of the two numbers p and q must be positive. If both p and q 








ee me oa 
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are positive then it can be shown by computing the inverse Fourier transform 
of (10) that (10) can be a characteristic function only if \ is a positive integer. 
The corresponding distribution is in this case a binomial distribution. If one of 
the numbers p and gq is positive while the other is negative then we see easily 
that \ < 0. In this case (10) is the characteristic function of a negative binomial 
distribution. 

The binomial as well as the negative binomial distribution have the property 
that the random variable assumes an extreme value with a positive probability. 
Let Lo be the extreme value which the statistic L may assume; we have then 
P(L = Ih) > 0. If L = Ly then the value of Q is completely determined. Let 
us denote it by Qo . Therefore the conditional probability P(Q = Q)| L = Ly) = 
1; on account of the assumed stochastic independence of Q and L this means 
that P(Q = Q) = 1 so that Q has necessarily a degenerate distribution. We 
see then from (1) that z” has also a degenerate distribution. We conclude that 
under the conditions (8.2) and (8.2.1) the case p > 0, q < 0 (or p < 0,q > 0) 
can not occur. The distribution of x has therefore necessarily the form 


(10.2) F(x) = pe(x — &) + ge(x + 6), 
where 
(10.3) p> 0, q> 90, p+q=l. 


If we take a = 0, then Q = bS. From (10.2) it is seen that S = na. = né with 
probability one and hence Q = DS is independent of L. Furthermore, if n > 1, 
aL’ + bS is not independent of L unless p = 0 or p = 1, and hence a must be 
zero and Q@ = b>." 2}. On the other hand it is easily seen that for the dis- 
tribution (10.2) the statistics Q = )° fix} and L = >>%i 2; are stochastically 
independent. This completes the discussion of the case where (8.2) and (8.2.1) 
hold. 


We still have to consider the possibility that (8.2) is valid while 


(8.2.2) has S (A — Day. 

In this case 8 is real. Clearly, we must have \ < 0 since otherwise y(t) would 
not be bounded. We put \ = —4u(u > 0) and write 

(11) v(t) = [pel™ + ge. 


Here p and qg must be both positive since otherwise y(t) would have a real pole. 
It is also seen easily that ¥(¢) has a maximum for a value f& given by é”° = q/p. 
Furthermore, if p # q we see that ¥(f) = [2~Wpq]” > 1, while ¥(&) = 1 if 
p = q = 3. If y(t) isa characteristic function we must therefore have p = q = } 
so that (11) reduces to 


7 4 r - 1 


(11.1) y(t) = ‘ , Bt} = II 7 
cosh 2 j=l 1 oe (23 — 1)? 
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The representation of Y(t) as an infinite product shows that (11.1) is a charac- 
teristic function. We s!io~w finally that for the distributions determined by (11.1) 
no homogeneous and s,,u.:netric quadratic statistic Q exists which is independent 
of the statistic L. This is proven by demonstrating that E(Q°L’) — E(Q*)E(L’) 
can not be zero for any distribution with the characteristic function (11.1). The 
symbol E denotes here as usual the expected value. 

By a somewhat tedious but elementary computation one obtains from (11.1) 
and (1) 


6 2 
E(Q°L’) — E(Q’) E(L’) = 4np (3) o'{( + 1)[(n + 2)y + 4] (°) 


b 

+ Un? + Sn)u? + (On + 8)u + 81(2) + (rw + Gnu + 2}. 
From » = —A) and (10.1) we see that b/a = —(nu + 1)/(u + 1). If we sub- 
stitute this into the previous equation and simplify we obtain finally 

‘a’ 1)(n — 1)8° 

12 E(Q'L’) — EQ)E(L) = MOH + Wm — DB 
(11.2) (Q'L’) (Q’) ) 8 + 1) 
Since »p > 0, this can be zero only if n = 1. Then either Q = 0 ora + b ¥ O. 
By (10.1) n = 1 and a + b ¥ O imply A = 1, which contradicts 1» = —\ > 0. 


The distribution functions (11.1), derived under the assumptions (8.2) and 
(8.2.2), do not therefore yield a solution of our problem. 

We next consider the case (8.3) by assuming A * 0,a + b = 0,na+ b ¥ 0. 
Equation (7) then reduces to [h(t)]? = —ai which leads to y(t) = e***"' andQ = 
2a) jor doi i412; . We see therefore that case (8.3) leads to no new distribu- 
tion as the degenerate distribution appears already in the preceding discussion. 


5. Discussion of the differential equation if A = 0. In this paragraph we 
assume 


(12.1) A = (a + b)az + (n — l)aai = 0, 


and rewrite equation (7) as 
dh 3 
(12.2) (a@+b7+ (na + b) h°(t) = 0. 


We &tart the discussion of equations (12.1) and (12.2) with four cases which 
lead either to an already known solution for the characteristic function or to a 
trivial solution for the statistic Q. We assume first 


(12.1.1) a=0. 


From (12.1.1) and (12.1) we see ba, = 0. If b = 0 we obtain the improper statistic 
Q = 0, which is independent of any other statistic whatever be the parent 








ae 
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distribution. If ag = 0, we obtain the characteristic function y(t) = 1. The same 
solutions (either y(t) = 1 or Q = 0) are also derived from (12.1), (12.2) and 
(12.1.2) a+b=0, 
or from (12.1), (12.2) and 
(12.1.3) a = 0. 
If we assume 
(12.1.4) na+b= 0, 
we obtain in a similar manner either the statistic Q = 0 or the characteristic 
function y(t) = e“™. 

We see therefore that if (12.1) holds the cases a = 0,a + b = 0, am = 0, 
na + b = 0 lead again either to a degenerate distribution which was fully treated 


in the preceding section or to the improper statistic Q = 0, which is a trivial 
solution of our problem. 


In the following we therefore discuss equation (12.2) only under the assump- 
tion that the four inequalities 


(12.3) a <0, na+b # 0, a+b +0, a, ~ 0 
:; . 5 d 1 o . 
hold. In this case (12.2) may be written as 7 h(t) = at? where o = 


a. — a; is the variance of the parent distribution. If we integrate this with due 
regard to the initial conditions we obtain 


. o'it a 
(13) $@ «11-55 1~S, 


This is the characteristic function of a gamma-distribution with parameters 


a = a/o,\ = ai/o. Its frequency function is given by 


9 
( a A-1 —az 


—— £ for x > 0, 
(13.1) f(a, a,r) = (TO) if a >0 
0 for « SG, 
and in case ay < 0 by 
(° for r= 0, 
(13.2) g(x, a, ) = \(—g) area 
| Ta) (—2x)” e for 2 <.@ 


Equation (12.1), which led to the characteristic function (13) of the gamma- 
distribution, determines also the statistic Q. It is easily seen from (12.1) that 
a /a; = —(na + b)/(a + b) = 1/X, therefore 


l 
(14) Se ee 3 
a A+ 1 
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We show finally that the gamma distribution determined by (13) as a solution 
of the differential equation (12.2) does not lead to a solution of our problem 
since no statistic Q exists which for any sample size is independently distributed 
of L. Suppose n > 1. Then | Q| = | a(L? — (ny + 1)/(A + 1)S)| Sl a| (2 + 
(ns + 1)/(A + 1)S). But S Ss L’ with probability one since all x’s are of one 
sign with probability one. Hence | Q| < | a| [((n + LA + 2)/(A + DIL’ with 
probability one. The range of the values of Q is unbounded, hence Q can not 
be independent of L. 
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ON A TEST FOR HOMOGENEITY AND EXTREME VALUES 


By D. A. Daruine 

University of Michigan 
Summary. Let x; , 22, --: , 2, be positive, identically distributed, independent 
random variables. It is of some statistical interest to study the distribution of 
Zn = (41 + 22 + +++ + 2n)/max (x;, t2, --: , tn). In this paper we give its 


characteristic function and in a few cases its distribution. A limiting distribution 
of fairly wide applicability is given in the last section. 


1. Introduction. Suppose x; , r2, --: , 2, are positive, independent observa- 
tions coming from populations with cumulative distribution functions F (02), 
F(oor), --- , F(o,x) respectively, where o; > O and F(z) is some known con- 
tinuous edf with F(0) = 0. It is of some practical importance to devise a test 
for the hypothesis H that o, = o2 = --- =o, . For instance, in the analysis of 
variance it is desirable to know if a set of n independent sample variances are 


“homogeneous,” or if to the contrary they come from normal populations with 
different variances. 
Let t, = a + 22 + ++: + 2, and m, = max(z, 2%, °°: , Xn), and put 


un, = m,/t,. A possible test consists of rejecting H when u, exceeds a certain 
value. In 1929 R. A. Fisher [1] used this test in determining whether the largest 
amplitude in a harmonic analysis was “significantly” large, H being the hy- 
pothesis that each x; was independently distributed as o°x* with 2 degrees of 
freedom. In 1941 Cochran [2] considered an extension to k degrees of freedom. 
Other writers have taken the ratio of an extreme variance to an independent 
estimate of the variance as a test for homogeneity and outlying observations 
(cf. Nair [3] and Finney [4]). This test is also used implicitly in quality control 
work to test the equality of scale parameters; here 2, %2, --- , 2, are each 
independently distributed as the range of a sample of size k. 

A test of the nature described above is supposed to have good power against 
alternatives which consist of the occurrence of just one anomalously large 
value of o, whereas for other alternatives (in the case of testing variances) the 
well known test of Bartlett (which is essentially the likelihood ratio test) is 
perhaps superior. This test might also be employed to determine the equality of 
location parameters in a set of cdf’s, and generally to test the significance of 
extreme values. Since, under H, the distribution of u, is independent of the 
common population variances (or is “Studentized” in the terminology of 
Hartley [5]), it is superior, for many purposes, to tests based on other order 
statistics (cf. Pearson and Chandrasekhar [6}). 

The distribution of u, when H is true is not, in general, known. In this note 
we consider the distribution of z, = 1/u, = t,/m,. Of course, the test of H 
using z, is identical to the test using u,, and if the critical rejection region 
using u, is u, > a, then the critical region using z, is z, < 1/a. We give the 
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characteristic function of z, and show how, in some cases, it can be used to 
determine the rejection region. 


2. The distribution of Z,. Let 2, 42, --- , 2n, t, and m, be the variables 
described in the preceding section, and let z, = ¢,/m,. Suppose the variables 
x; have the common density ¢(x), x > 0. Then for the characteristic function 
of z, we have the following formula, proven in [7]: 


5 oo 1 7 n—l 
(2.1) E(t) = E(e'"*) = ne | (6[ e* ¢(ap) da) ¢(8) dp. 


In certain cases it is possible to invert this Fourier transform, and so obtain 
the distribution of z, , and in any case we can find all moments of z, in terms 
of quadratures. For example, the mean is 


p = E(z,) = : (0) = 1+ n(n — » | (F(g))”” 


{ I $(8u) du — oa} ¢(8) dg, 


where F(8) is the cdf, that is, F(8) 


[ o(x) dz. 


We consider a few examples. 

(a) Suppose the variables x; are uniformly distributed over (0, 1)—or for 
that matter uniformly distributed over any finite interval (0, a), since the 
distribution of z, is independent of a. Then (2.1) becomes 


ss at 1 n—1 
eco = (=) 


and we have the rather surprising result the distribution of z, is the same as 
the distribution of 1 + y: + ye +--+ + yaa, Where #1, Y2, -** Yn—1 are inde- 
pendent and uniformly distributed over (0, 1). This fact may also be readily 
deduced from certain properties of order statistics of uniformly distributed 
variables which have been studied recently by Malmquist [8]. 

(b) Let the variables have the density 


(2.2) fay 


1 
¢(x) =  e 
k 
(5) 


which is the density of 2x’ with k degrees of freedom. For variables which have 
the density o’x’ the characteristic function of z, is given by (2.1) with ¢(z) as 
in (2.2). If k is an even integer we can find the distribution function of z, ex- 
plicitly. Let k = 2r + 2 where r is an integer 20. Then (2.2) becomes 


’ 


o(z) = + ez’, 
Tr! 
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and if we work with the Laplace transform £,(7t) rather than &,(¢), (2.1) becomes 


(2.3) t(it) = Ele) = net [| y*(@) | &* 6 ag, 
r! 


where 


via) =F [ (ap) Or a 


8 r+1 
-(,8,) a- «PG +0), 


in which P,(z) is the polynomial P,(x) = Dine x'/j!. Now &,(it)/t is the Laplace 
transform of the cumulative distribution function of z,, and (2.3) can be re- 
written 


° ~ (n—1) (r+1) 
i «= / (1 ~ :) . (u — 1)" (1 — &™“*P,(ut))”"*¢ e™ du. 
-#1 


Letting 


1 (n—1) (r+1) 
) (u — 1)’, 


u 


and f“(u) = 0 for all k = 0 and u < 1 we have 


4 28 Cem LG) erm 


J 
and putting (P,(z))' = >i» af?2’, 


ya) Ay 


n 


Be a) Con LG &°G) opm 


val) 


and this expression can be now directly inverted termwise to give 


Pris l= AEG) COYE oh Senl(5)(G) } 


J 
or finally 


1 n . at 
Pr {z,S 2 ze (*\-oF Fe 
j J vent) 


r! s z 
(2.4) ee 


ry *\ (n—1) (r+1) r , 
(1-2) (= -1)(2), ls2zSn. 
dat" x J J 


0, and calculate the distribution of u, = 1/2, , (2.4) becomes 


Priu>s}= + (")-v"a —#y', 121, 
isi<(ilz) \J n 


If we put r = 
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which is the result of Fisher [1]. Cochran [2] showed how to express the terms 
of u,, corresponding to (2.4), for an even number of degrees of freedom as 
multiple integrals of Beta functions, and on the basis of certain approximations 
gave a table of approximate percentage points for u, . This table, as well as a 
subsequent table by Eisenhart, Hastay and Wallis [9], appears to be subject 
to certain indeterminate errors (cf. [9] ch. 15). 


3. A limiting distribution. In example (b) above it is possible to find a limiting 
distribution for z, when n — * which may be of use when n is large. (The 
limiting distribution for u, = 1/2, given by Cochran [2] appears to be erroneous 
owing to an oversight concerning the dependence of a set of random variables.) 


We remove the restriction that r be a nonnegative integer and merely require 
r> —1. Then 


¢(8) = he 


1 
r(r + 1) ° 
and £,(t) is given by (2.1). Now define f(8) = 1 — F(é) = [ ¢(x) dx and 

1 
v@) = 1-40) +8 (e™ - 1)6(a8) da 
1 — f(s) + g(8), 


so that &,(t) = —ne'* [ vy” (8) df(8). It is necessary to study the behavior of 
0 
g(8) for large 8, and it is simple to show that 


1 . 
9(8) = B [ (e — 1)$(a8) da 


= 40, Aesmer? , (5), p> @ 


8 B 2 B 
for bounded | ¢ |. 


We next need to get an asymptotic solution to the equation nf(8) = v for B 
when n — ©; that is, we need to solve 


ex dz 


n oe 
"TC + nd, 


for 8 when n — o. An asymptotic development similar to that above shows 


that we have 
n ee r 1 
°" ern" #(1+5+0(5)) 


as an equation to solve for 8. After some calculation we find 


B = log n +r log log n + 17 8 1E™ _ og (or(r + 1)) + 0( =} 


log n log n 
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and hence 


ae _ , log log n log (oI'(r + 1)) ( <5) 
log? n/’ 


B 7" log n log? n log? n 
so that 


¥(8) = 1 — f(@) + g(8) =1-—< + ir + 1) 


{ l — Tela 4 og OTe + D+ of 1 )}. 


log n log? n jog? n log? n 
Now define numbers c, and d, as follows: 
Cn = (r + 1) pars? 
d, = logn — r log logn + log I(r + 1), 
and it is simple to verify that 


tit. iin _v , ttlogv yy 
gali/egeme = ott [1 — 2 4 18 4 o(L))" a, 


n 


and that when n — © the limit may be taken under the integration sign to 
give 


tn(t/ce,)e 4" I e *titloee Wy) = Pit + 1). 


But the expression on the right is simply the characteristic function for the 
random variable log w, where w has the exponential density e*, and hence 


lim Pr{z,/cn — dx < z} = Pr{logw < z} =1—e€™, —-o <4< ow, 
by the continuity theorem for characteristic functions. It does not follow, of 
course, that the constants c, and d, are the “best” in the sense that they give 
the “closest”? approximation to the limiting distribution function when n is 
finite. 

Finally, then 


n--o 


lim Pr (r+ 1) = ofr + 1) OBIE" + Or + 1) log rr + 1) 


n log | 
log 1 log? n 
+ oe be + Die od ~ oe, —-e <zr< om. 
log? n log? n 
4. A general limiting expression. Following the analysis of Section 3, it is 
possible to get a general limiting distribution for z, for quite a broad class of 
distributions ¢(x). There are two essentially distinct cases. 


(a) If x, is bounded (i.e., if ¢(x) = Ofor x > 2) then m, = max (2, , 22, -** , Xn) 
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tends with probability 1 to some sure number M and hence z, has the same 


asymptotic distribution as 1/M (x, + a2 + --- + 2,)—-that is, the Gaussian 
distribution. 


(b) If « = E(z,) exists and z, is unbounded from above we define, as before 
¥(8) = 1 — f(8) + g(8), where 


1 : 
(8) = Bf (ec — 1)6(a8) da, 


so that (2.1) becomes &(t) = —ne" I (¥(8))""* df(), f(8) being 1 — F() = 


[ ¢(z) dx as in Section 3. An asymptotic development for g(8) is 
8 


(a) = # + o(2), Ba, 


and as before we must solve nf(8) = v for 1/8, asymptotically forn — o. 
Let us suppose that there are constants a, and b, such that if nf(8) = v, v 
bounded, 


(1) ; = a, + h(v)be +fa (0), 


an 


—O0 n> © 
nbn ; 


(3) fa (v)/b, — 0 uniformly for v in any closed interval0 <e Sv SM < ~. 


Then h(v) is a monotone increasing function, and we consider the normalized 
variable (z, — yuna,)/unb, . For its characteristic function we have 


s . n--1 o 
Ealt/nbyerstea) =f (1 -% - =e +0(2)) fe [ Hae ay 
0 


As a consequence the normalized variable has the limiting distribution of 
h(w), where w is distributed with an exponential density e-*. Hence 


~~ & —h- lz) 
_—_ — > = l — 
Pr{ 2 5 <x a} Pr {h(w) < 2} e : 


Pr {zn < punan+ unb,t} +1 — &*', 
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ON THE STOCHASTIC APPROXIMATION METHOD OF 
ROBBINS AND MONRO! 


By J. WoLFrow!Tz 
Cornell University 
1. Summary. In their interesting and pioneering paper Robbins and Monro 
[1] give a method for “solving stochastically” the equation in x: M(x) = a, 
where M (zx) is the (unknown) expected value at level z of the response to a certain 
experiment. They raise the question whether their results, which are contained 
in their Theorems 1 and 2, are valid under a condition (their condition (4’), 
our condition (1) below) which is statistically plausible and is weaker than the 
condition which they require to prove their results. In the present paper this 
question is answered in the affirmative. They also ask whether their conditions 
(33), (34), and (35) (our conditions (25), (26) and (27) below) can be replaced 
by their condition (5”) (our condition (28) below). A counterexample shows 
that this is impossible. However, it is possible to weaken conditions (25), (26) 
and (27) by replacing them by condition (3) (abc) below. Thus our results 
generalize those of [1]. The statistical significance of these results is described 
in [1). 


2. Statement of the problem. Let H(y | z) be a family of distribution func- 
tions which correspond to real values of the parameter x. Write 


M(z) = Fi y dH(y | 2). 


We postulate that 


(1) |M(z)| SC < @, [ (y — M(z))? dH(y| 2) So’ < », 


and that either 
M(x) Sa — 4, forz < @, 
M(x) 2 a+ 4, forz > 0, 


(2) 


for some 6 > 0, or else 
M(x) < aforz < 8, 
(3a) M(8) = a, 
M(x) > aforz > 6, 
and, for some positive 6, 
(3b) M(z) is strictly increasing if |z — 6| <6 


1 Research under contract with the Office of Naval Research. 
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and 


(3c) inf | M(z) —a|>0. 


| 2—#| 


Let {a,} be a sequence of positive numbers such that 
(4) _ Gn = ®, 
nal 
(5) > a. < @, 
n=l 
Let 2, be an arbitrary number. The Robbins-Monro convergence scheme is 
defined recursively for all n by 


Tati = In + an(a “a Yn)s 


where y, is a chance variable with distribution function H(y|z,). We shall 
prove the following 


Tuerorem. If (1), (4), (5), and either (2) or (3) (abc) hold, then x, converges 
stochastically to 0. 


3. Proof of the Theorem. Let 


bn = E(x. _ 6)”, 
d, El(zn —_ 6)(M (xp) __ a)}, 


en =E i (y — a) dH(y | |. 


Then, from (1), 
(6) Oses0°+(C+|al)>=h (say). 


An examination of the proof of [1] shows that, since (6) is valid, the fol- 
lowing results of [1] hold under our assumptions: 


(7) b, — a limit, say b, asn > ©; 


(8) d, = 0; 
(9) > Andy < ©; 


n=l 


(10) bar = bi + Di aje; — 2D adj. 
From (4) and (9) we obtain 
(11) lim inf d, = 0. 


Let ny < mn, < +--+ be an infinite sequence of positive integers such that 
(12) lim d,,; = 0. 
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We assert that z,, converges stochastically to 6. If this were not so, there 
would exist an infinite subsequence t; < t2 < --- of the sequence of n;, and 
positive numbers ¢ and 7 such that, for all j, 


(13) Pity —0|>2) >« 
But then for all ¢; we would have 

d,, = El(a, — 0)(M(%,) — a)] 
(14) = Eljm,; — 6| | M(%,) — a|) 


ey inf | M(z) — al. 
—@\|2% 


| 2 


From either (2) or (3) (abc) it follows that the last member of (14) is positive. 
This contradicts (12) and proves the assertion. 

Let ¢ and 7 be arbitrary positive numbers. Our theorem is proved if we can 
demonstrate the existence of an integer N(n, ¢) such that, ifn > N(n, «), 


(15) P{|z, — 0|>n} Se. 
Let s be a positive number such that 


(16) 


Since z,, converges stochastically to @ there exists an integer No such that 


(17) P{| rx, — | 2 8} <5 


and 
(18) 


Define, forn > No, 
ba(z) = E{(an — 0)*| aw, = 2}. 
From (6) and (10) we obtain 
(19) bale) S @ — 0) +h Dah Ss @- 6) +5. 


j=No 


Consequently, when n > No, 


2 
(20) P{|z-0/za\lam—al<sp<*t*<s 


n* 


2 


by (19) and (16). From (17) and (20) we conclude that (15) holds with N(y, «) = 
No. Thus our proof is complete. 
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4. Two counterexamples. 


4.1. We show that (1) ((4’) in [1]) cannot be completely removed. Suppose 


that 6 = a = 0, and define H(y | x) for x < 1 in any,way whatever provided 
only that 


M(x) = 2, i oe <1, 

M(z) = —1, z<-—l. 
For all x such that 
(21) Figeas.4 

ani 2 ani N 

define H(y | x) as follows: 
(22) H(y |x) = 0, ys —1, 
(23) Hy|2) =1-3, ~l1<ys 2-1, 
(24) H(y| 2) = 1, y> 2-1. 
We have M(x) = 1 for x = 1. Thus M(z) satisfies 
(25) M(z) is nondecreasing, 
(26) M(6) = a, 
(27) — | _, > o 


(These are the conditions (33), (34), and (35) of [1].) 
Now let a, = 1/n and 2, > 2. We have 


1 
P {tau > In| Yi = Ye = occ BY, = —1} el-s 
for all n > 1, and 
Pia, > 2} = %. 
Hence t':ere is a positive probability that rz, — ©. 
4.2. We show that the condition 


M(x) < a, + <x ¢ 
(28) 
M(x) > a, x> 4, 


(which is condition (5”) of [1]), and the condition (1) (or even the stronger con- 
dition (4) of [1], ie., that there exist a positive constant C’ such that 


(29) [anu |) =1 
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identically in x) are not sufficient for the theorem to hold. Let a, = 1/(4n), 
6 = a = 0. For all x we define 


(30) Hy | z) =~ 0, y s M(x), 


(31) H(y|z)=1, y> M(2). 


We define M(0) = 0, M(1) = 1. Let x, = 1. Thenz, = %. If z, = y, for n = 2 
we define M(y,) = (4n)™*. Since }>%_21/(16n) < 4, we have 


P{z, > \%}=1 


for all n. We can define M(x) at points x not included in our construction above 
in any manner compatible with (28). 

The author is obliged to his colleague Professor J. C. Kiefer for helpful dis- 
cussions while this paper was being written. 
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STOCHASTIC ESTIMATION OF THE MAXIMUM OF A REGRESSION 
FUNCTION! 


By J. Krierer anp J. WoLFrowitTz 
Cornell University 


1. Summary. Let M(x) be a regression function which has a maximum at the 
unknown point @. M(z) is itself unknown to the statistician who, however, can 
take observations at any level x. This paper gives a scheme whereby, starting 
from an arbitrary point z;, one obtains successively x2, x3, --- such that z,, 
converges to 6 in probability as n > «. 

2. Introduction. Let H(y |x) be a family of distribution functions which 
depend on a parameter z, and let 


(2.1) M(z) = [ y dH(y | x). 


We suppose that 


(2.2) [ w- M@ any | s8<-, 


and that M(z) is strictly increasing for « < 6, and M(z) is strictly decreasing 
for z > 6. Let {a,} and {c,} be infinite sequences of positive numbers such that 


(2.3) Cn — 0, 

(2.4) Lan = &, 
(2.5) Lanta < &, 
(2.6) Yiaicn < @. 


(For example, a, = n™,c, = n~*.) 

We can now describe a recursive scheme as follows. Let z, be an arbitrary 
number. For all positive integral n we have 
(2.7) Zntt = 2n + On (Yan — Yas) : 
where Yyon-1 and ye, are independent chance variables with respective distribu- 
tions H(y|z, — c,) and H(y|z, + c,). Under regularity conditions on M(z) 
which we shall state below we will prove that z, converges stochastically to 
6 (asn — ~), 

The statistical importance of this problem is obvious and need not be dis- 


cussed. The stimulus for this paper came from the interesting paper by Robbins 
and Monro [1] (see also Wolfowitz [2]). 


1 Research under contract with the Office of Naval Research. Presented to the American 
Mathematical Society at New York on April 25, 1952. 
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While we have no need to postulate the existence of the derivative of M(x) 
(indeed, M(x) can be discontinuous), the spirit of our regularity assumptions 
postulated below is as follows. (a) If M(x) did have a derivative it would be 
zero at x = 6. Hence we would have expected the derivative not to be too large 
in a neighborhood of x = @. (b) If, at a distance from 0, M(x) were very flat, 
then movement towards @ would be too slow. Hence outside of a neighborhood 
of x = 6 we would have liked the absolute value of the derivative to be bounded 
below by a positive number. (c) If M(x) rose too steeply in places we might 
through mischance get a movement of z, which would throw us far out from @. 
If there were many such steep places z, could be made to approach + © or— 
with positive probability. We would therefore have postulated a Lipschitz con- 
dition. 

From the mathematical point of view it would be aesthetic to weaken the 
conditions. From the practical point of view it might be objected that these 
conditions prevent M(x) from being a function which flattens out toward the 
x-axis, for example, M(x) = e*, or from being a function which drops off 
steadily faster to — ©, for example, M(x) = —z’. Now in any practical situa- 
tion one can always give a priori an interval [C,, C.] such that C; S$ 6 S C2. 
It will be sufficient if our conditions are fulfilled in this interval. 

Suppose, however, that some z, + c, falls outside the interval [C; , C2} and 
one cannot take an observation at that level. If one then moves z, so that the 
offending z, + c, is at C, or C,, as the case may be, and proceeds as directed 
by (2.7), then our conclusion remains valid. 

We postulate the following regularity conditions on M(z). 

ConpITIon 1. There exist positive 8 and B such that 


(2.8) |2’ —06|+|2” — 0| < B implies | M(z’) — M(z”)| < Bl 2’ — 2” |. 
ConpITION 2. There exist positive p and R such that 

(2.9) | 2’ — 2” | < pimplies | M(x’) — M(z”)| < R. 
ConpITION 3. For every 6 > 0 there exists a positive +(é) such that 


| M(z + «) —~M@-o)\, a 


(2.10) |2—6|> 6 implies inf 
6 


45>e>0 € 


5). 


3. Proof that z, converges stochastically to 0. Let 
(3.1) b, = E(z, — 8)’, 
(3.2) U,(z) = (2 — 0) Efyon — Yon+| 2n = 2}, 
(3.3)  Unx(z) = 4(Un(z) + | Un(z) |), Unlz) = 3(Un(2) — | Un(e) |), 
(3.4) P, = E(U%(en)), Nn = E(U3(2,)), 


(3.5) ce, = E(Yeon — Yan-1)*. 


ET ar 


ee ier 
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From (2.7) we have 


2 
(3.6) bets = bn + 252 (Py + Na) + en. 


Adding the expressions obtained from (3.6) for bj4; — 6; for 1 S 7 S n, we 
obtain 


n n n 2 

(3.7) bar = +2 DSP, 4+2 0 9N, 4+ Se. 
jai Cj jai Cj j=l C; 

Noting that Ut(z) = 0 and that Ut(z) > 0 implies that | z — @| < c, because 


M(x) is monotonic for x < @ and for z > 8@, it follows from (2.8) that, for all 
n for which c, < $8, we have 


(3.8) 0 < Uk@) <2Be, 
It follows from (2.5) and (3.8) that the positive-term series 
(3.9) > 2p, 
nal Ce 
converges, say to a. From (2.9) we have 
(3.10) [M(2n + Cn) — M(zn — Ca)|’ < BR 


for n sufficiently large. Also for large enough n, 
E{ (Yon _— Yor-1)” | Zn} 
(3.11) = E{ (yon — M(2n + ¢n))” + (Yat — M(2n — Cn)” | 2n} 


+ [M (2, + ¢,) — M (zn = en] s2S+RF 
by (2.2) and (3.10). Hence for large enough n 


(3.12) Elyen — Yara)’ S 2S + R’. 
Consequently from (2.6) we obtain that the positive-term series 
C 2 
(3.13) pe 
n=l Cy 


converges, say to y. Hence, since 6,4: 2 0, it follows from (3.7) that 
(3.14) SF. 28, & -h ~ te = ob He, 
j=l Cj 
so that the negative-term series 
(3.15) a 2 N, 
nal Cn 


converges. 
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Let 


M(2n + Ca) — M(2n — Cn) 


Cn 


(3.16) K, = 


Then 
“e 
(3.17) E(K.|2, -—0|} = oo Nw 


From the convergence of (3.9) and (3.15) and the divergence of 2 a, , it fol- 
lows that 


(3.18) lim inf E{Kn|z, — 6|} = 0. 


n—-2o 
Let n, < m < --- be an infinite sequence of positive integers such that 


(3.19) lim E{Kn,|2., —9|} = 0. 


je 


We assert that (z,,; — 4) converges stochastically to zero as j — ~. For if not, 
there would exist two positive numbers 6 and ¢ and a subsequence {t;} of {n;} 
such that, for all j, 


(3.20) P{|z,—-0|> 6} > 6, 


which implies that 


(3.21) E{Ki,|2, — |} = dex (5) >0 


for all j for which c,, < 36. But (3.21) contradicts (3.19) and the stochastic 
convergence to zero of (z,; — @) is proved. 

Let » and e be arbitrary positive numbers. The proof of the theorem will 
be complete if we can show the existence of an integer N(n, €) such that 


(3.22) P{|z,—6|> 7} S eforn > N(zn, ©). 
Let s be a positive number such that 


2 
(3.23) Sethe 
n 


Because z,, converges stochastically to @ there exists an integer No such that 
(3.24) P{\zvy —0|2 8} <5. 
We may also choose No so large that 


(3.25) Cn, < min (s. 4 for alln = 








eel 
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and 
= a, 8 

(3.26 = <sea 

2X c, 2R? + 4S’ 
and 
— = 8 
(3.27) a GnCn < = 


n=No 8B 


Proceeding in a manner similar to that used to obtain (3.7), we have, for each 
n> No ’ , 


n—1 


E{ (2, — 0)*|zv, = 2} = (2-0)? +2 >, SE{U;|zn, = 2} 
j=No Cj 
n—1l a. 
(3.28) + 2) Ef (ya; — yx)*| 2x, = 2} 


=N . 
? 0 C; 


S (2-0 +2 D SE(US em = 2) + (R428) DS <e-H +s. 


j=No Cj G=No Cj 


Using (3.23), (3.28), and Tchebycheff’s inequality, we have 
(3.29) P{| zn — 0 > n| 2m —6| <8} <5. 


The inequalities (3.24) and (3.29) show that (3.22) holds for N(n, «€) = No, 
and the proof is complete. 


4. Further problems. The following remarks about further problems apply 
also to [1]. 

A. An obvious problem is to determine sequences {c,} and {a,} which would 
be optimal in some reasonable sense. 

B. An important problem is to determine a stopping rule, that is, a rule 
by which the statistician decides when he is sufficiently close to @. 

C. This problem is a combination of B and a generalization of A, that is, 


* to determine an optimal procedure with its stopping rule. 
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NOTES 


AN ASYMMETRIC BELL-SHAPED FREQUENCY CURVE 


By Fausto I. Toranzos 
Mendoza, Argentina 


1. Summary. Frequency functions of the form (1) below including Pearson’s 
system as a special case are derived from a generating differential equation (2). 
Their properties are discussed, methods of fitting them are suggested, and their 
characteristic function is determined. 


2. Introduction. We wish to contribute to the study of the frequency functions 
of the form! 


(1) y = f(x) exp{—4a’ (x — b)* }. 


We will realize this purpose by taking as a generating differential equation of our 
system of frequency functions 


y’ _ Qmsi(z) 


y P,,(x) 


in which Q is a polynomial of degree m + 1 and P another of degree m. Carrying 
out the division of the polynomials of (2) gives 


et Qm—1(x) 
(3) y =ar+B+ Pla) 


and integrating 


Qm—1(a) 


an bk owmti : f | = 
y = kexp{jaxr + Br +¢(x)}, (x) P,(a) 


dx. 


The integral g(x) can always be evaluated by decomposing it into integrals of 
the forms 


| dx __ Mz +N . 
(x — a)r’ (z?+ pr+q) - 


Bearing this in mind, it is easy to show that, if a < 0 and the roots of the de- 
nominator are simple, y is equal to the Gauss function multiplied by Pearson’s 
functions. When there are multiple roots, exponential factors will appear. 
Pearson’s system is a particular case of (3) when a = 0, 8 = 0 and m = 2. 
1 In this work we generalize and complete the results that we have given in [1]. 
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3. The case m = 1. The case m = | is particularly important. The correspond- 
ing differential equation is 


y’ ao Aox’ a Aix “+ Ag 
on Br+Bo 


Making a change in the origin of x, we have 


(4) y’ _ ax + ar + a 
z , 


y = kexp {(= + ny x, 


This function gives bell-shaped curves when az < 0, a > 0. Now putting 


ay = —a’, a;/a. = b, a = c, we have 


and integrating, 


(5) y = kx* exp {—}a’ (x — b)’}. 


The graph of y is a bell-shaped curve with zeros at the points x; = 0, 22 = ~, 
if we take as the range of x,0 S x S ~. In this interval y has only one maximum. 

This case if of great importance due to its possible applications in distributions 
of bell-shaped frequencies with a finite range to the left of the maximum and 
extending to infinity on the right. Such happens in the case of the distribution 
of relative percentage values of prices and volume, in which the decrease is 
limited (from 100% to 0%), whereas the increase is theoretically unlimited 
(from 100% on). In spite of the natural asymmetry, the curve is remarkably 
close to the Gauss curve in the vicinity of the maximum. 

When az > 0 and a < 0 we have a U-shaped curve which has a minimum 
near x = b, and which becomes infinite at x = Oandz = ~. 

When a2 < 0 and ay < 0 we have a curve which has a zero at the point z = ~, 
a minimum near the origin, and a maximum near x = b, and which becomes 
infinite at the origin. 

When a2 > 0 and ap > 0 the curve has a zero at the point z = 0, a maximum 
near x = OQ, and a minimum near x = b, and becomes infinite at r = «. 


4. Determination of the constants. In order to fit the function (5) to an 
empirically determined frequency series, we may use the method of moments 
in the same way as Pearson does for his system. 

The differential equation (2) can be expressed as 

xdy = y (aoa + ayx + a). 
Multiplying by 2° and integrating from 0 to », we have 


—(s + 1l)m, = agmiy2 + AiMs41 + Ams, 


in which m, are moments of order s. Identifying the functional moments with 
the empirical moments and giving successively the values 0, 1, and 2 to s, we 
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have a system of three equations with three unknowns from which we can de- 
termine a2, a; , a, and therefore a, b, and c. 


We can also determine the constants by the least squares method using the 
equation 


ny = lazer t+ar+ainz+C. 


The value of C should be adjusted so that it satisfies the condition 


[ var =1. 
0 


5. Determination of the characteristic function. The characteristic function 
o(t) of (5) is defined by 


¢(t) = ‘| x’ exp{—}a"(x — b)* + izt} dz. 
Multiplying out the square, and putting ab = p, ax = u we have 
a a f it\ | \ 
g(t) = ka~“*” exp{ —4a°b*} [ u° exp yo oo (» aa it) u> du 
0 4 
(6) ka~*” exp{ —}a7b"} Lecpyayey [u® exp{ —}u7}] 


= ka“*” P(e + 1) exp{ —}a"b? — 3(p + it/a)’} D_cery [—p — it/al, 


writing L for the Laplace transform, and D,(z) for Weber’s function of the 
parabolic cylinder [2]. 

This function can be expressed by Whittaker’s confluent hypergeometric 
function, which has been tabulated [2]. 

To determine the value of K it is sufficient to make ¢ = 0 in (6), giving 


. 2) 
¢(0) = 1 = ka “*” P(e + 1) exp { — 4a" = a} D_e+1) [—pl, 


and therefore 


(e+1) ( z 
eee  / = 
= Tet I) oxP \ 22 b+ 7} D-<e+1) [— ab], 


and finally 


o(t) = exp {it = a D-¢e41) {—ab — it/a)/D—¢e+1) [—ab]. 


Now we can determine the moments and other characteristics of the function 
(5). 
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REMARKS ON A MULTIVARIATE TRANSFORMATION! 


By Murray RosenBLatr 
University of Chicago 
The object of this note is to point out and discuss a simple transformation® 


of an absolutely continuous k-variate distribution F(x, , --- , 2) into the uni- 
form distribution on the k-dimensional hypercube. A discussion of related 
transformations has been given by P. Lévy [1]. 

Let X = (X,,---, X,) be a random vector with distribution function 
F(a, -++ , a). Letz = (4, -°++, 2) = Tx = T(a,--: , 2), where T is the 
transformation considered. Then 7’ is given by 

a = P{Xi Sm} = Fi(x), 


az = P{X,S% | Xi = %} = F2(x2 | %1), 


zw = P{ XiSau| tea=tr,-++,Xiem} = Fe(re| ter, --+ 2). 


One can readily show that the random vector Z = TX is uniformly distributed 
on the k-dimensional hypercube, for 


P{Z; 8 2;1= 1, --+,k} 


[ c++ f dey Pulte | tea, -*+, 21) +++ dz, Fy(a) 
{2124 s2%} 


2k 2) k 
[ rs [ dz eo dz, = Il Zi, 
0 0 : 


t=1 
when 0 S 2; S 1,7 = 1,---, k. Hence Z,,--- , Z are uniformly and inde- 
pendently distributed on [0, 1]. 


Let Xi = (Xiw, -** , Xe), t = 1, «+: , n, be a random sample of 
n vectors from a population with distribution function F(a, , +--+ , 2) and let 


G(a, +--+, 2x) be the corresponding sample distribution function. It has been 
found that the probability distribution of the Kolmogorov-Smirnov statistic, 
max | F(x, ---, 2%) — G(a, --+, 2) |, 

Sie ooh eae 

is not the same for all continuous F when k > 1 [2]. The same can be said for 
the multidimensional von Mises statistic 


[ | (F(a, +++, te) — G(x, +++, te))* dey-.2y P(r, +++, x). 


However, it would still be of interest to study the Kolmogorov-Smirnov and von 
Mises statistics for the case of sampling from a population uniformly distributed 
on the k-dimensional hypercube. One could test whether the X;) ,7 = 1, --- ,n, 
are a sample from a population with distribution function F(a, --- , 2%) by 


1 Work done under ONR contract. 


2 I have recently learned that J. H. Curtiss and I. R. Savage have also considered this 
transformation. 
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using either the Kolmogorov-Smirnov or von Mises statistic to test whether the 
Zi = TX, are a sample from a population uniformly distributed on the k- 
dimensional hypercube. Both statistics are invariant under permutation of the 
Xiw,t = 1,---,n. 

The transformation is of some interest in setting up regions of equal probability 
mass in a chi-square test of goodness of fit. Assume again that one wishes to test 
whether the X,. , 7 = 1, --- , n, come from a population with absolutely con- 
tinuous distribution function F(z, , --- , 2,). This, as remarked before, is equiva- 
lent to testing whether the Z,, = TX.) ,7 = 1, --- , n, come from a population 
with distribution function z --- z, where 0 S z; S 1,j = 1,---, k. Divide 
the k-dimensional hypercube into the N* cells 

OP ={2 * < 2; <4 a t= |, sy Bh, 
where j;, --* , jx = 0,1,-+--,N — 1. Each of these cells has probability mass 
1/N* under the null hypothesis. Let »;,...;, be the number of transformed ob- 
servations Z,; = TX, in C;,...;,. The chi-square statistic 


( Y ) 
Yiyik — 

N* 
X n/N* 


can be used to test whether the sample X,;,) comes from a population with 
distribution function F(a, ,--- , 2%). A test for goodness of fit based on the 
chi-square statistic above is consistent asn, N — ~. 

There are k! transformations T of the type described above corresponding to 
the k! ways in which one can number the coordinates x, , --- , x. One might 
think this unsatisfactory because of a suspicion that the experimenter might 
carry out one of the procedures described above with each of the k! transforma- 
tions and then choose that particular transformation which yields the result he 
wishes to obtain. But this situation can arise in any case where there is a multi- 
tude of tests in the same context. 

The transformation 7 can be written down explicitly in several cases. We shall 
write down the transformation when F(z, , --- , 2) is a normal distribution with 
mean M = (m,, --- , m) and covariance matrix A = {A;;},7%j = 1,---,k. 
Let A” = {di}, %,9 = 1,---,7 S k, and A$? be the cofactor of { Ag } in 
A’. The transformation 7 is then given by 


aA ™% 
ria) = 027m). 
te — m2 + (Ag /Ag2) (a1 — mi) 
F,(a2| 2) = ® (A084 eae) ’ 


k-1 
te — ™m + a (Anj/ Ann) (x; — my) 


VA/Aex 


Fy (ay | tea, +++,u) =@ 
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. oe , ; . 2 
Let F(x: , 22) be a normal distribution with means m, , m2 , variances a; , 72 and 
correlation coefficient p. The transformation can then be written as 


re — M + 
F(x | a) = @ 2 
o/1 — p? 
REFERENCES 
{1] P. Livy, Théorie de l’Addition des Variables Aléatoires, Gauthier-Villars, Paris, 1937, 
pp. 71-73, 121-123. 

[2] Paut B. Stmpson, ‘‘Note on the estimation of a bivariate distribution function,” 

Annals of Math. Stat., Vol. 22 (1951), pp. 476-478. 
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ABSTRACTS OF PAPERS 


(Abstracts of papers presented at the Eugene meeting of the Institute, June 19-21, 1952) 


1. The Auditory Cortex—A Probability Model. Arcute R. Tunturt, University 
of Oregon Medical School. 


The role played by the brain in communication is well known, but in what manner the 
brain handles information is not understood. Some progress has been made in this direction 
by studying the anatomy and physiology of the auditory cortex in the anesthetized dog 
with controlled acoustic signals. Communication may be thought of as making a represen- 
tation in a space of a representation in another space. In three of the four auditory areas 
(on one side of the brain), the entire frequency spectrum from 100 to 12800 eps is repre- 
sented literally spacewise by groups of cells that respond only to a narrow range of fre- 
quencies. A special method increases the signal to noise ratio, by augmenting the electrical 
response of the cells, thereby permitting exact measurements of the characteristic fre- 
quency and intensity for each group of cells. This is similar to a narrow band filter, and 
does not reveal the effect of other frequencies on the information. The information capacity 
of the system can be inferred if it can be assumed that occurrence of the augmented re- 
sponse for the group of cells follows some probability function. These probabilities for all 
groups of cells can be assembled into a model representing the behavior of the system as a 
communication device. If there are 70 groups of cells between 100 and 12800 cps, the proba- 
bility of any particular combination would be 1/2”, if the selections were equally probable. 


The effect of noise on this system will be considered. (Research sponsored in part by the 
Office of Naval Research.) 


2. Testing Message Diffusion: The Utilization of Mathematical Models. 
Sruart C. Dopp, Ricnarp J. Hitt, anp Susan Hurraker, University of 
Washington. 


In connection with the study of interpersonal verbal communication, the Washington 
Public Opinion Laboratory designed an experimental procedure which yielded data on the 
temporal diffusion of thirty-three different messages in a population of 184 individuals. 
Data (including the recipient of each message, the initiator of communication, and the 
time of communication) were obtained on 5,522 separate instances of communication. The 
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experimental population was selected so that the assumption could reasonably be made 
that it was homogeneous relative to the interacting (i.e., each individual had an equal 
probability of interacting), and uninfluenced by the spatial factor in diffusion. In the 
attempt to describe the temporal diffusion of the messages, three rational mathematical 
models were compared with the empirical results. The models utilized were the logistic, 
the normal ogive, and the binomial distribution, for which the mathematical conditions 
are well identified. The experiment had been designed to match those social conditions 
underlying the communication with the mathematical conditions underlying the logistic 
model (namely, a constant probability of interacting in the population and through time). 
The higher and lower degrees of descriptive closeness and goodness of fit for the three 
models, and for ordinal and cardinal time units separately, are reported and discussed. 


3. On the Method of Collective Marks. Herman Rusin, Stanford University. 


In Colloques International du Centre National de la Recherche Scientifique, No. 13, D. van 
Dantzig considered the application of the method of generating functions to run problems. 
Let 2, °:* , 2n, *** be a sequence of nonnegative integer-valued random variables of 
which only a finite number are nonzero with probability one. Then E(II?_, ¢;*) exists for 
|¢;| $1. 1f0 S t; S 1, then we can interpret ¢; as the probability that a coin when tossed 
will come up heads. Let an experiment be performable independently an arbitrary number 
of times with results a; with probability p; , and let us ask questions concerning the num- 
bers of runs of various types obtained. One may compute the generating function of the 
various quantities involved by performing the experiment n times with probability 
A"(1 — A). If y; is the number of occurrences of a; and z;, is the number of runs of length 
k of type j, then P = E(S* TI ui IL o,j*) = 1 — + Dj fjP;, where fj = De(ApjSu;)*vjn 
and P is the probability that no tail occurs and P; is the probability that in addition a; 
is not the first outcome of the experiment. Then P; = P — f;P; and hence P = (1 — d)/ 
(1 — 2jf;/(1 + f;)). Then such questions as to number and type of runs in n experiments 
can be answered from the conditional generating function. Other types of questions can 
be answered by letting \ approach 1. 


4. On Asymptotic Properties of Estimates. Lucren LeCam, University of 
California, Berkeley. 


Let f(x, 6) be a probability density depending on a parameter 6. Under regularity con- 
ditions on f(z, @) it is shown that, for a broad class of loss functions and for positive con- 
tinuous a priori densities: (1) The maximum liklihood (M. L.) estimate is asymptotically 
equivalent to a Bayes estimate. Moreover all ‘‘regular’’ asymptotic Bayes estimates are 
equivalent. (2) Given any estimate 7’, there exists a randomized estimate 7, asymptotically 
equivalent to 7’, and depending on the sample point by means of the M. L. estimate only. 
(3) If an estimate 7’, is super-efficient at a point 6) there exists a sequence 6, , 0, — 6 of 
points at which 7’, is worse than the M. L. estimate, except maybe for a finite number of 
values of n. 


5. The Principle of Invariance Applied to a Problem of Classification. Rosepiru 
SITGREAVES, Stanford University. 


A problem of classification considered by Wald and Anderson is as follows: an individual 
is to be classified on the basis of p measurements as coming from one of two populations, 
Il; or ll, . The distribution of the measurements in each population is multivariate normal 
with the same covariance matrix, but with different expected values. The parameters of 
the distribution are unknown, but samples of NV, observatiofs from II; and N, observations 
from Il, are available. Both Wald and Anderson proposed classification procedures de- 
termined by substituting sample estimates for unknown parameter values in the ap- 
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propriate Bayes’ solution for the case when the parameters are known. Optimum properties 
for these procedures are difficult to prove because the two alternatives are composite. If 
the possible procedures are restricted by adopting the principle of invariance, there is 
obtained a family of classification procedures depending on a single nuisance parameter 
such that the class of procedures defined for a fixed value of the nuisance parameter is a 
complete class. In a single case, namely, when N; = N:2 and the losses due to misclassifica- 
tion are equal, the minimax procedure is independent of the nuisance parameter, and 
depends upon classification statistics proposed by Wald and Anderson. 


6. Optimum Selection Procedures. Epwarp PauLtson, University of Wash- 


ington. 
Let (Y1, Yo, --- , Ye, X) be a (kK + 1) dimensional random variable, with 
Y,, Y2,-+:+: , Y~ denoting the admission scores of an individual on a series of k admission 


tests and X the performance or achievement score of the same individual. Optimum pro- 
cedures for selecting or rejecting an individual on the basis of his observed admission scores 
have been investigated by Birnbaum, Chapman, and Cochran. By considering the X scores 
as playing the role of a parameter with respect to the conditional distribution of 
Y,, ¥2,--: , Ye when X is fixed, two additional procedures are derived, each optimum in 
a certain well defined sense. The second of these procedures, which is analogous to a Bayes 
solution and minimizes the average loss in classifying an individual, can easily be ex- 
tended to the problem of classifying an individual on the basis of his admission scores into 
one of 3 or more classes, providing that the appropriate loss functions and the conditional 
probability distribution of X for fixed values of Y;, Y2,--- , Ys, are known. 


7. A Theorem on Convex Cones with Applications to Linear Inequalities. 
Jerry W. GappvuM, Institute for Numerical Analysis. 


I can summarize the results as follows: It is proved that if A is a convex cone in E, and 
A* its polar cone, A and A* have a non-null vector in common unless A is an E, . This is 
applied to obtain the result that Az = 0 has a solution if and only if AA’y 2 0 has a non- 
negative solution. Results due to Dines and to Motzkin are then applicable to obtain further 


existence theorems. The theorem on convex cones also provides a method of solution of 
systems of inequalities. 


8. On the Prediction of Nonstationary Stochastic Processes. R. C. Davis, 
Bureau of Ordnance. 


During a finite time interval T the real valued function S(t) + N(t) is observed, in which 
S(t) is a signal and N(¢) is a linearly superimposed noise disturbance. The problem is to 
predict the value of a given linear functional of S(t), the predictor formula having certain 
preassigned ‘‘optimum properties’? among a certain class of predictors. In the case in 
which the mean value of S(t) is known, the random components of S(t) and N(t) are strictly 
stationary, and the time interval T is infinite, a complete solution to this problem has been 
given by N. Wiener. (In the case of discrete time series, the solution was given by A. Kol- 
mogorov.) This theory has been extended by L. Zadeh and J. Ragazzini to the case in 
which T is a finite time interval and the mean value of S(t) is unknown but is restricted 
to be a polynomial in time. The above theory is extended to the case in which the random 
components of both S(t) and N(¢t) are nonstationary in time and merely possess finite 
continuous covariance and cross covariance functions. The analytical methods of proba- 
bility theory used are those developed by M. Loéve and K. Karhunen in their studies of 
stochastic processes of second order. These techniques are very powerful in the analysis of 
transient random phenomena in linear systems. Finally an exposition is given of pre- 


diction by the method of conditional probabilities, and this method is compared with the 
least squares method. 
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9. Power Efficiency Function for Normal Alternatives for Several Nonpara- 
metric Tests. W. J. Drxon, University of Oregon. 


Power curves are computed for samples of size 3, 4, 5 for the maximum absolute devia- 
tion, the rank-sum, and the median tests for normal alternatives. These curves are com- 


pared with the power curves for the t-test. (Research sponsored by the Office of Naval 
Research.) 


10. Bounds for Second Moments of the Sample Range. Sicerr1 Moricutt, 
University of North Carolina and University of Tokyo. : 


Let R be the range, that is the difference between the two extreme values, of a sample 
of size n from a symmetrical population with variance o?. This paper deals with the least 
upper bound for E(R*) /o?, the greatest lower bound for the coefficient of variation of R, 
and the greatest lower bound for V(R) /o?. It is shown that these can be obtained as char- 
acteristic values of certain integral equations. For n even, these equations can be reduced 
to linear algebraic equations. Numerical results are given for small values of n. 


11. Estimates, Tests, and Tolerance Intervals for Lump Data from a Normal 
Distribution. Harry M. Hueues, University of California, Berkeley. 


If N independent samples from a normal distribution with unknown mean yu and un- 
known variance o* are lumped into m subsamples of known size, and if the sums of the 
subsample values are observed but not the individual values, then the variance of the 
maximum likelihood estimate of » is unchanged but the variance of the maximum likeli- 
hood estimate of o? (modified to remove bias) is increased to that of a sample of size m. 
The effect on confidence intervals and on standard tests such as the t-test and F-test follows 
immediately. 

The effect on tolerance intervals, not heretofore easily available, is presented in the 
form of a table of factors, depending on m, N and the confidence coefficient y by which to 
modify existing tables of the coefficient \ in the expression # + As. The range covered is 
m = 2 to 100, N = 3 to 1000 for N > m; confidence coefficients .75, .90 and 99; and all 
tolerance coefficients (percentage of population to be covered) since table entries are 


independent of the tolerance coefficient. The resulting increase in the expected length of 
the tolerance interval is indicated. 


12. A Computing Formula for the Power of the Two-Sided t-Test for Even 
Degrees of Freedom. Wres.trey L. NicHoison, University of Oregon. 


A general formula is exhibited for the power function of the “two-sided” t-test for 
even degrees of freedom. The form employed is particularly adapted to computation of 
the power for various alternative means, given fixed arbitrary type I error and even degrees 
of freedom. The power functions for 2, 4, 6, 8, and 10 degrees of freedom are written out 
explicitly with an indication of their use for arbitrary type I error. 


13. On the Analysis of Data Matched in Pairs. Frank J. Massey, Jr., Uni- 
versity of Oregon. 


We supose that groups & four observations are drawn under varying environmental 
conditions for the different groups. In each group two of the individuals are subjected to 
one treatment and the other two are subjected to a second treatment. This paper discusses 
various parametric and nonparametric techniques of analyzing the data. Power curves are 


given for the case where the two populations are normally distributed differing only in 
mean value. 
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14. The Power Function of the Haldane-Smith Test. B. M. Bennerr, Uni- 
versity of Washington. 


Haldane and Smith (Annals of Eugenics, 1948) have devised a non-parametric test for 
the existence of a birth order effect in families in which a certain number of sibs are affected 
by a particular disease. The test consists of summing the ranks of all affected individuals. 
The distribution has been worked out under the assumption that all ranks are equally 
likely. It is shown that this test may be regarded more generally as a test for the constancy 
of the probability of an event from trial to trial when it is known to occur a fixed number 
of times out of a given number of trials. The power function of the test has been considered 
with respect to several classes of alternatives concerning the successive probabilities of 
the event. 


15. Spectral Analysis of Stationary Time Series. (Preliminary Report.) ULF 
GRENANDER AND Murray RosENBLATT, University of Chicago. 


Having observed a sample sequence (finite) of a vector-valued stationary time series, 
one wishes to make inferential statements about the spectrum of the underlying process 
on the basis of the sample. Assume that the process is a linear process and that the spectrum 
satisfies certain regularity conditions. There are three aspects to the work being carried 
out. 1. Obtaining curve-estimates of the spectral density and spectral distribution function. 
These estimates have been chosen as different types of quadratic forms in the sample 
values. 2. Obtaining confidence bands and confidence regions for both the spectral density 
and spectral distribution function. Certain limit theorems nonparametric with respect to 
the spectrum have been obtained in connection with this aspect of the problem. 3. These 
limit theorems have also been used to construct one and two sample tests for time series. 
We plan to set up a sampling program to test the approach to the limiting distributions. 
Artificial time series will be generated and submitted to analytic techniques provided by 
the theory. In this connection, schemes of computation are now being devised. Auxiliary 
tables are under preparation. (This work is being done under the sponsorship of the Office 
of Naval Research.) 


16. Asymptotically Subminimax and Asymptotically Admissible Statistical 
Decision Procedures. Jack LADERMAN, Columbia University. 


A study is made of the asymptotic behavior of the minimax decision procedure when 
the distribution space, 2, consists of a finite number of absolutely continuous distribution 
functions and the decision problem is to select the true distribution function when a sample 
of size n is known. It is seen that ‘‘asymptotically subminimax”’ procedures frequently 
exist which are clearly more desirable than the minimax procedure when n is sufficiently 
large. Let ri(T,,) denote the risk associated with the decision procedure 7’, when the i-th 
distribution is the true distribution. A sequence of decision procedures, {7',}, is said to be 
asymptotically admissible if there does not exist another sequence of decision procedures, 
{T..}, such that lim... ri(T,)/ri(T,) S 1 for all values of i and the strict inequality holds 
for at least one value of 7. A detailed study is made of the class of problems for which Q 
consists of k univariate normal distributions all having the same variance but different 
means. The minimax decision procedure is found to be asymptotically admissible only for 
very special sets of values for the k means. For other sets of mean values, asymptotically 
subminimax procedures are obtained which are also asymptotically admissible. For still 
other sets of mean values, it is shown that no asymptotically subminimax procedure exists 


which is also asymptotically admissible. (This research was sponsored by the Office of 
Naval Research.) 
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17. Note on the Problem of Combining Independent Tests of Significance. 
ALLAN Brrnspaum, Columbia University. 


The “problem of combining independent tests of significance”’ is stated and illustrated. 
A distinction is made between two kinds of problems of combining tests. A definition of 
admissibility of a method of combining tests is proposed. A simple characterization of a 
minimal essentially complete class of methods of combining tests for a large class of prob- 
lems is given (in terms of the proposed definition of admissibility). For a simple common 
testing problem, the properties of several methods of combining tests which have been 
recommended in the literature are examined and compared with properties of the optimal 
test for this problem. It is shown that some of these methods correspond to inadmissible 
test procedures for the original problem; other methods correspond to admissible pro- 
cedures, and on the basis of their properties one may base a selection of a method of com- 
bination of tests, for use in problems which seem similar to that under consideration 


18. On Judging all Contrasts in the Analysis of Variance. (Preliminary Report.) 
Henry Scuerrs£, Columbia University. 


Under the usual (general linear hypothesis) assumptions, if the conventional F-test of 
the hypothesis H: 6; = 6.2 = --- = 6 at the a level of significance rejects H, what further 
conclusions are valid about the contrasts among the 6; (beyond the conclusion that the 
contrasts are not all zero)? Suppose the F-test has k — 1 and » degrees of freedom. For 
any ci, °°: , ce With D*c,6; = 0 write y. for the contrast Dic,4;, and write y. and s*(j.) for 
the usual estimates of ¥- and the variance of ¥. . Then for the totality of contrasts y. the 
probability is 1 — a that they all satisfy (*) |¥.—¥.| S Se(}.), where S? is (k — 1) times 
the upper a point of the F-distribution with k — 1 and » degrees of freedom. Say that the 
estimated contrast %. is “significantly different from zero” if the interval (*) does not 
cover the point ¥. = 0. Then the F-test rejects H if and only if some We are significantly 
different from zero, and if it does, one can say just which 9, . More generally, the inequali- 
ties (*) can be employed for all the contrasts with the obvious frequency interpretation 
about the proportion of experiments in which all statements are correct. Relations are 
considered to an earlier method of Tukey using the Studentized range tables (‘‘Allowances 
for various types of error rates,’’ invited address before IMS meeting at Blacksburg, Va., 
March 19, 1952; see also Proc. Fifth Annual Convention A.S.Q.C., 1951, pp. 189-197). (Work 
sponsored by the Office of Naval Research.) 


19. Further Moving Average Methods in the Estimation of LD-50. B. M. 
BENNETT, University of Washington. 


Further extensions of the moving average methods for estimating LD-50 proposed by 
W. R. Thompson and the author (Jour. Hyg., 1952) have been developed in order to in- 
clude minimum variance and minimum variance unbiassed estimates from any assumed 
distribution of threshold. Numerical estimates of the efficiency of such procedures are 
included. 


20. Nonparametric Theory: Confidence Regions and Tests for Location and 
Scale Parameters. (Preliminary Report.) D. A. S. Fraser, University of 
Toronto. 


All unbiased estimates of zero are characterized for the class of probability density 
functions having the p percentile at the origin. As a consequence, results are obtained 
for location parameters (percentiles), for scale parameters (interpercentile ranges), and 
for combination location and scale parameters. All randomized 8 level confidence regions 
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for a location parameter can be described in a simple functional form. All confidence bounds 
for a location parameter are almost everywhere equal to the order statistics chosen with 
fixed probabilities; all distribution-free upper tolerance limits are of the same form, the 
Robbins condition, II(f(2 , --- , zn) — 2:) = 0 almost everywhere, being necessary but 
not sufficient (unless f is continuous). Most powerful one-sided and most powerful (short- 
est) unbiased confidence regions are obtained for the location parameters. Correspond- 
ingly, most powerful and most powerful unbiased tests are obtained for the location param- 
eter. For the scale parameter similar or exact confidence regions do not exist. Analogously, 
similar tests do not exist for the scale parameter. For the scale and location parameter, 
confidence regions can be obtained; most powerful intervals exist for specific purposes. 
If the location parameter is known UMV unbiased estimates do not exist for any other 
parameter. 





21. Random Functions Satisfying Certain Linear Relations. I. 8. G. Guurye, 
University of North Carolina. 








Let X(t) be a random function of the real parameter ¢, and let there exist k continuous 
functions a;(h), --- , ax(h), of h > 0, such that for any ¢t and any h > O, the sequence 
{Y(t,h;n),n = 0,41, --- }, defined below, satisfies certain assumptions about independ- 
ence. Here Y(t,h;n) = X(t + (n+ k)h) + an(h)X(t + (n +k — Ih) +--+ + on(h)X(t+nh). y 
In other words, it is postulated that any sequence of observations made at equidistant 
t-points on the X-process satisfies a hypothesis of the type commonly expressed in terms 
of linear stochastic difference equations. Certain consequences of this assumption are 
studied in this paper. For instance, in all the cases considered, it is shown that the possible 
forms of the a;(h) are restricted by the property that the roots of the following equation 
in x can be written in the form e*i*, the \; being independent of h: z* — a,(h)z* — --- 
— ax(h) = 0. It is also shown that, under certain conditions, the Y-sequence is (k — 1)- 

" dependent for all h, but can be independent for all h only if the X-process is deterministic. 


22. Computational Experience in Solving Linear Programs. A. J. Horrman, 
National Bureau of Standards. 


This is a report of the experience gained in solving linear programs on the SEAC (Na- 
i tional Bureau of Standards Eastern Automatic Computer) by the simplex method, relaxa- 
qi . . *,* 
tion, and fictitious play. 





23. Duality of Multi-valued Means. Tuyropore S. Morzxin, University of p 
California, Los Angeles. 
| 


In problems of statistical measurement and estimation, especially of angles and similar 
geometric quantities, and in their application including data preparation for linear pro- 
gramming, the question comes up how to define the mean for periodic variables. For these, 

1 as the example of equidistant points on a circumference shows, a unique and rotationally 
invariant mean cannot be defined. A multivalued and invariant mean is obtained as follows. 
For a set S on a smaller are the arithmetic mean is ordinarily found by choosing a zero 
point on the complementary are A, . It is reasonable to invest this mean with a weight 
proportional to the length of A; , and the means obtained from zeros on the ares A2,--- , 
A, with corresponding weights. One may try repeating the procedure with respect to the 
set S’ of weighted means in view of possible convergence: however it turns out that S” = S. 
More generally for every circular distribution S the analogous definition of a mean by a 
Stieltjes-Lebesque integral leads to a dual or complementary distribution S’, and S” = S. 
Similar facts hold on the torus (two periodic variables). On a sphere, even local associ- 
ativity cannot be upheld; obtaining the mean of a finite set from the means of its finite 
subsets by iteration and passing to the limit, or as a minimum for the sum of the squares 
of spherical distances, are two transcendental (essentially infinitely-valued) definitions. 
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24. A Note on a Dynamic Leontief Model with Substitution. Grorce B. 
Dantzic, The Rand Corporation. 


In an important class of discrete dynamic Leontief models with substitution, an optimal 
program for the entire time span can be obtained by determining locally the optimal basis 
for the first time period alone, followed by determining the optimal basis for the second 
time period given the first, etc. It follows that the relative weights in the objective func- 
tion of performing the various activities in any time period do not affect the choice of activi- 
ties in earlier time periods although, of course, they may affect the levels of activities in 
the early time periods. Thus, optimal bases for a sequence of periods are found in the 
order: Period 1, Period 2, Period 3, --- , after which activity levels are found by ordinary 
back-solution for linear equations in the order Period n, Period n — 1, Period n — 2 


25. Confidence Intervals on the Slopes of Regression Lines when Both Variables 
are Subject to Error. C. O. Junag, Jr., University of Washington. 


In the problem of linear regression when both variables are subject to error, Reiersol 
has shown that if the errors and the “steady” parts are normally distributed then the 
slope of the desired regression line is not identifiable. If the errors in the two variables 
are independent, however, a conservative confidence interval on the slope of the regres- 
sion line can be determined even though the slope is not identifiable. If the “‘steady”’ 
parts are a set of fixed but unknown values, independent estimates of the rank of the steady 
parts are sufficient to determine a meaningful confidence interval. In case an instrumental 
variable as defined by Geary is available, a confidence interval can be determined. 


26. Statistical Estimation from Time and Population Samples. Jutius A. JAHN, 
Washington State College. 


Given a population of individuals, J:1, --- , N; , and a variable V; defined over this 
population, a random sampling procedure is to be designed to provide unbiased estimates 
of the mean value of V; for the population with a minimum variance of the estimated 
values for certain fixed sample sizes and other cost conditions. When the variable is de- 
pendent upon time, the use of estimates from samples enumerated during one period of 
time to apply to later periods of time can lead to large and increasing bias due to changes 
with time. The solution proposed in this paper is to sub-divide the total period of time 
into a series of conveniently short intervals, 7':1, --- , Ny, and to define as the universe 
to be sampled, the set of points (it) formed by the combinations of the identification num- 
bers for time intervals (t) and those for the individuals in the population (i). Correspond- 
ingly, the variable is defined over these points (V;,) in such a way that the sum over the 
time intervals for any one individual is equal to V;. A sample design incorporating the 
use of weekly time intervals as “‘strata’’ within which were selected a random sample of 
points in each strata and a constant sampling rate for each strata was applied to derive 
estimates of the mean value of the total expenditures of students at the University of 
Washington during the Winter Quarter of 1951. 


27. The Analysis of Samples from Mixed Populations. (Preliminary Report.) 
D. G. CHAPMAN, University of Washington. 


Samples from natural populations will frequently include a mixture of several races 
or age groups. The analysis of such a sample into its component parts is useful for the 
determination of growth rates, mortalities, or the characteristics of the mixed populations. 
Several cases arise according to whether or not a simple age identifying factor is avail- 
able, or whether or not supplementary information is available from other samples. Ney- 
man’s extended x? formulae can be applied to these problems to analyze the mixed samples 
into their component parts, and to estimate characteristics of the mixed population. Aux- 
iliary problems that arise in utilizing the supplementary information are considered. 
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28. Some Applications of the Log-Normal Distribution to the Study of Survival 
Times in Chronic Fatal Diseases, Particularly Leukemia. Haroip Tivey, 
University of Oregon Medical School. 


Illustrations of some of the types of disease processes in which a log-normal distribu- 
tion will closely approximate the distribution of survival times will be presented. A sum- 
mary of survival data on over 2600 cases of leukemia taken from the literature will be 
briefly presented, with particular emphasis on the statistical problems arising from this 
investigation. The application of the maximum likelihood method of Boag will be dis- 
cussed. 


29. Field Trial Problems. G. A. Baker, University of California, Davis. 


Theoretical and empirical examinations of the correspondence of certain field trials 
to conventional mathematical models have been made. The correspondence may be quite 
good bit on the other hand serious defections do exist. It seems apparent that a careful 
study of field plot design and methods of analysis are necessary in order to obtain more 
accurate measures of plant performance on definite plots. The classical mathematical 
models have led to marked advances in the theory and practice of field trials and no at- 
tempt is being made here to belittle their importance. The point that is being made is 
that when finer distinctions between varieties and treatments are attempted even minor 
deviations from mathematical theory are important. Every effort must be made to im- 
prove investigative tools. This can be done in two ways. One is to develop more realistic 
models. This often fails because of lack of detailed knowledge of uniformity trials, in- 
ability to predict the behavior of biological material in complex situations, and because 
of mathematical difficultiese The other general method of improving field trials is to ar- 
range the plots, select the plants, modify overall conditions, or transform the data so 
that classical models will clearly indicate differences. 


30. Population Forecasts, State of Washington, 1950-1960: Methodological 
Summary. Cavin F. Scumip, Vincent A. MILLER AND WARREN E. KaAt- 
BACH, University of Washington. 


The cohort-survival method was used to prepare the population forecasts for the State 
of Washington, April 1, 1955 and April 1, 1960, based on detailed data covering: (1) an 
age-sex breakdown of the population on which projections are to be based, (2) age-sex- 
specific mortality trends, (3) age-specific fertility trends for females in child-bearing ages, 
(4) age-sex-specific migration trends. Estimates are made of the age-sex distribution of 
the population as of the forecast dates. 


31. On the Addition of Chi-Squares. (Preliminary Report.) Jack Borstine, 
University of Oregon. 


An example is used to compare the power of three tests of a simple hypothesis specify- 
ing the cell frequencies in discrete population. The tests are as follows; the chi-square 
test based on a single sample, a chi-square test based on the addition of five independent 
chi-squares from separate samples, and a test which rejects the hypothesis if any one of 
the several chi-squares is significantly large. For the example considered the power of 
the single sample test was considerably greater than the power of the other two tests. 
For example, for one alternative the power of the single sample test is 0.41 and the power 
of the test using the sum of chi-squares is 0.20. Curves are drawn comparing the powers 
for a set of alternatives. 
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32. Decisions Based on Incomplete Information. Norman Daukey, The Rand 
Corporation. * 


It is shown that the usual requirements of consistency, continuity, and convexity in 
choices made under incomplete information have the consequence that the decision maker 


must be guided by a set of weights, analogous to probabilities, for the possible relevant 
states of nature. 


33. Method of Synthesizing an Autonomous Shipbuilding Industry for an Inter- 


industry Input-Output Model. Caprain J. E. Hamitton, George Washing- 
ton University. 


The paper presents a data-gathering and reduction program and methods of computa- 
tion to construct a synthetic shipbuilding industry to provide a vector of inputs for a 
portion of the national bill of goods. This bill of goods is treated as an autonomous industry 
for application to a Leontief Input-Output matrix. The purpose of this is to test the Inter- 
Industry technique as to its suitability for testing the feasibility of military programs. 
The work consisted of assembling data sufficient to construct a suitable number of ‘‘proto- 
type”’ bills of material for complete ships; of establishing a program of shipbuilding with 
sufficient breadth to embrace any industrial impact during the four year period under 
construction; of classifying the units in the program by similarities; of computing multi- 
pliers for material and manpower to pantograph the type to one of the prototypes; of 
developing a formula for computing manpower requirements by time periods; of program- 
ming computing machinery to compute material requirements by time periods; of calcu- 
lating a vector of overhead inputs and a method of computation to include impacts of 
overhead; and of aggregating material, labor, and overhead into a single time-phased 
vector of total inputs from each of 192 industries. 


34. A Mathematical Model of the Shipbuilding Industry. R. F. WititaMs, 


George Washington University. 


This paper is a model of task of data gathering involved in an analysis of the industry- 
by-industry requirements in a ‘‘ship-building program.’’ Such a program, in general, 
includes a variety of tasks other than actual building of ships, e.g. ship repair, ship con- 
version, etc. The set of data required for a program, P, is a matrix of numbers, {Xj}, such 
that each X;; is a measure of the material from the jth one of the n industrial segments 
serving the shipbuilding industry, required by the SBI during a certain (the ith) time 
segment for the program, P. First, as the raw data are necessarily found on a ship-task 
to ship-task basis, these must be amalgamated to arrive at the matrix {Xj;}. Thus an 
inquiry was made into the various possible means of amalgamation and a formalization 
of these techniques is presented. Secondly, the only practical such measure has been found 
to be the unit known as the “‘fixed dollar.’’ Therefore, as the cost of a ship-task includes 
cost of material and cost of labor, a special inquiry is made into their respective records 
of data: bills of goods and wage scales, and a formal analysis of these is presented. 


35. Distribution-free Tests of Fit for Continuous Distribution Functions. Z. W. 
BrrnBauM, University of Washington. 


This expository address deals with distribution-free techniques for deciding whether 
asample xz; , 22, -°-- , 2, of a one-dimensional random variable was obtained from a p>pula- 
tion with a completely specified continuous cumulative distribution function H(z). A 
number of such techniques are described and discussed. It is observed that all of them 
are based on statistics of the form ¢{H(x), --- , H(z,)] where ¢(u; , +++ , Un) is a sym- 
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metric function. The concepts of a distribution-free statistic and of a strongly distribu- 
tion-free statistic are introduced, and the theorem is stated that, under fairly general 
assumptions a strongly distribution-free statistic must be of the form ¢[H(2z), --- , H(z,)]. 
A program is outlined for introducing various metrics in the space of distribution func- 
tions and for investigating the power of distribution-free tests with respect to these metrics. 


36. Acceptance Inspection by Variables when the Measurements Are Subject 
to Errors with Known Variance. Epwarp A. Fay anp Jonn E. WaAtsu, 
U.S. Naval Ordnance Test Station, China Lake. 


The situation considered is that where measurement of the characteristic of interest 
is not exact but subject to noticeable error. The measurement error is assumed to be inde- 
pendent of the true value of the characteristic measured and to be unbiased with known 
variance. The variance of the true values of the characteristic measured is assumed to 
have a known lower limit which is greater than zero. The probability distributions in- 
volved are assumed to be normal while the true values and measurement errors each form 
a random sample. For suitable specified acceptable and unacceptable fractions defective, 
this paper presents one-sided acceptance inspection criteria which have the property 
that the producer and consumer risks have specified upper bounds. Two-sided criteria 
can be obtained by appropriate utilization of the one-sided results. 


37. A Two-Sided Criterion for Acceptance Inspection by Variables. Epwin L. 
Crow, U.S. Naval Ordnance Test Station, China Lake. 


It is desired to test whether a submitted lot has an acceptably small proportion de- 
fective, where an item is considered defective if a measurable characteristic is either less 
than a prescribed number or greater than another prescribed number. Two approximate 
solutions making use of measurements on each item of a sample of fixed size have been 
given by Wallis and Arnold (Selected Techniques of Statistical Analysis, Columbia Uni- 
versity Press, 1947, pp. 52-57, 63-64). One of these simply combines two one-sided criteria 
and yields a triangular acceptance region in the (Z, s) plane in the usual notation. The 
other corresponds to an acceptance region within the above triangle. The OC curves (prob- 
ability of acceptance vs. lot proportion defective) of these criteria for particular values 
of the parameters are calculated by graphical integration. They depend on the lot mean. 
By interpolation between bounding ones of these OC curves it is possible to find an ac- 
ceptance region intermediate to the two mentioned above for which the OC curve varies 
inappreciably with the lot mean. This two-sided criterion is generalized to the case in 
which the measurements are subject to error. 


38. Acceptance Inspection by Variables in the Presence of Measurement Error. 
Epwarp A. Fay, U.S. Naval Ordnance Test Station, China Lake. 


The lot acceptance criterion ¢ + ks S U for sampling inspection by variables (where 
U is the upper limit to acceptable quality) is generalized to allow for measurement error. 
If m measurements are made on each item of a sample of size N, the generalized criterion 
if of the form % + ks, S U, where s is the standard deviation of the NV item means. Under 
the assumption that the ratio r of standard deviation of measurement error to standard 
deviation of product variability is known, a straightforward generalization of the deriva- 
tion of Wallis (Selected Techniques of Statistical Analysis, Columbia University Press, 
1947, pp. 59-61) leads to the appropriate value of k for the case that m, N, and one point 
on the OC curve are preassigned, and to the appropriate values of k and N in the case 
that m and two points on the OC curve are preassigned. It is shown that measurement 
error increases the sample size required to achieve the same OC curve in the ratio 1 + 
2r?/[m(k*? + 2)], where k is the value appropriate to the case of no measurement error. 
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Consequences of departure from the assumption of known r are investigated by compar- 
ing OC curves. 


39. On Continuous Inspection Plans. (Preliminary Report.) GerAup J. Liesper- 
MAN, Stanford University. 


This paper presents two extensions of the first continuous sampling plan devised by 
H. F. Dodge (Annals of Math. Stat., Vol. 14 (1943), pp. 264-279). Dodge’s scheme pro- 
vided for 100% inspection until 7 consecutive non-defective units were observed, at which 
time partial inspection was instituted, namely, one out of 1/f units was inspected. As 
soon as a defect was observed, 100% inspection was reinstated. It is proven in this paper 
that whether the process is in a state of statistical controi or not, an AOQL is assured. 
In fact, it is shown that always AOQL SS (1/f — 1)/(i + 1/f). The second problem con- 
sidered was that of obtaining a continuous sampling plan for the individual characteristics 
constituting an item. This paper presents a continuous inspection scheme similar to 
Dodge’s for r such characteristics, where r is any finite integer. It guarantees an overall 
AOQL provided the process is in a state of statistical control. The procedure is as follows: 
units are divided into segments of 7 items as they are manufactured. The k™ characteristic 
(k = 1,2,--- ,r) is inspected 100% until the preceding full segment is found free of defects 
in characteristic k, at which time partial inspection is instituted, namely, one out of 1/f 
units is inspected for characteristic k. Full inspection is reinstated for any charactistic as 
soon as a defect in that characteristic is observed. 


40. An Acceptance Procedure with Two-Sided Specification Limits. Grorer J. 
REsNIKOFF, Stanford University. 


A two-sided acceptance test in sampling inspection by variables is devised. The test 
is based on an estimate of the proportion defective which is optimum in the sense of mini- 
mum variance among unbiased estimates. In the one-sided case this estimate leads to 
the well-known test # + ks S U, where U is a single upper limit defining quality. Graph- 
ically the test is a region in the (#, s) plane. The probability of a sample point (7, s) fall- 
ing in the region is a function of the lot mean as well as of the proportion defective, but 
the resulting band of OC curves is so narrow, for the cases investigated, as to enable it 
to be considered a single curve insofar as industrial applications are concerned. Numerical 
investigation indicates that this property is itself virtually independent of the sample 
size. Since the acceptance region is inherently associated with the one-sided test, 7 + ks, 
the OC curve of this one-sided test may be used as an approximation to the OC band of 


the two-sided test. 
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NEWS AND NOTICES 


Readers are invited to submit to the secretary of the Institute news items of interest 


Personal Items 


Mr. Richard Berger, formerly with General Aniline & Film Corporation, is a 
Sales Analyst with General Dyestuff Corporation, New York City and is an 
Instructor in Statistics at Rutgers University. 

Professor D. A. Darling, on leave from the Department of Mathematics, 
University of Michigan, is Visiting Assistant Professor of Mathematical Sta- 
tistics at Columbia University for the academic year 1952-53. 
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Miss Marjorie Easterbrook, who recently received her M.A. degree from the 
University of Michigan, has accepted a position in the Research Department 
of the Holley Carburetor Company, Van Dyke, Michigan. 

Dr. N. L. Johnson of University College, London will be engaged in teaching 
and research in the Department of Mathematical Statistics of the University of 
North Carolina for the year 1952-1953. 

Mr. Edward C. Molina was awarded the Honorary Doctor of Science Degree 
by the Newark College of Engineering. 

Dr. Ingram Olkin, formerly research assistant at the University of North 
Carolina, accepted an assistant professorship in Mathematics at Michigan State 
College. 

Dr. Howard Raiffa, formerly at the University of Michigan, has been ap- 
pointed Assistant Professor of Mathematical Statistics at Columbia University. 

Professor Herbert Robbins of the University of North Carolina has been 
awarded a Fellowship by the John Simon Guggenheim Memorial Foundation 
and will spend the year 1952-53 as a member of the Institute for Advanced 
Study. 

B. J. Winer has accepted a post-doctoral Ford Foundation Fellowship at the 
Institute of Mathematical Statistics of the University of North Carolina. The 
fellowship was set up for the purpose of having the incumbent study the possible 
applications of recent advances in mathematical statistics to experimental 
design in psychology. The Department of Psychology at North Carolina is co- 
sponsor of the fellowship. 

Dr. T. O. Yntema has recently been appointed Vice President of Finance at 
Ford Motor Company, Dearborn, Michigan. 

During the academic year of 1952-53, the following members of the Institute 
will be in residence at Cornell University: Robert E. Bechhofer, I. Blumen, 
W. T. Federer, C. R. Henderson, Mark Kac, Jack Kiefer, P. J. McCarthy, 
Garnet E. McCreary, J. E. Morton, T. A. Ryan, A. Schultz, Milton Sobel, 
R. G. D. Steel, and Lionel Weiss. Professor Bechhofer will be on leave from 
Columbia University to serve as Director of the Statistical Laboratory in the 
newly formed Statistics Center at Cornell. Dr. Milton Sobel will work with him 
on an Army Air Force Research Project. R. G. D. Steel, formerly of the Mathe- 
matics Department, University of Wisconsin has accepted a position as As- 
sociate Professor in the Biometrics Unit of the New York State College of 
Agriculture. Professor Lionel Weiss will be on leave from the University of 
Virginia to teach in the Department of Mathematics during the absence of 
Professor J. Wolfowitz, who will be on leave during the coming year. 


Cn mB 


Announcement has been made of competition for Fulbright awards for uni- 
versity lecturing and post-doctoral level research of Americans in Austria, 
Belgium and Luxembourg, Denmark, Egypt, France, Greece, Iraq, Italy, Japan, 
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Netherlands, Norway, Pakistan, Turkey, Union of South Africa, United King- 
dom and Colonial Dependencies. Application must be made to Conference 
Board of Associated Research Councils, Committee on International Exchange 


of Persons, 2101 Constitution Avenue, Washington 25, D. C., no later than 
October 15, 1952. 


Preliminary Actuarial Examinations 
Prize Awards 


The winners of the prize awards offered by the Society of Actuaries to the 
nine undergraduates ranking highest on the score of Part 2 of the 1952 Prelim- 
inary Actuarial Examinations are as follows: 


First Prize of $200 
Freimer, Marshall............. Harvard University 
Lew, John 8. Ja acide Yale University 
Additional Prizes of $100 
Bauman, Norman.... Harvard University 
Guinane, J. E...... Brown University 
Horowitz, Michael. .. i Cornell University 
Kerr-Lawson, Angus ......University of Toronto 
Krause, Ralph M.......... .........+.Harvard University 
Muckenhoupt, Benjamin. .... ies Harvard University 
Potthoff, Richard......... ........ Swarthmore College 


Ordinarily only one $200 prize is offered, but this year two candidates tied for 
first place. Each candidate was awarded a $200 prize. 


The Society of Actuaries has authorized a similar set of prizes for the 1953 
examinations based on the Part 2 scores. 

The Preliminary Actuarial Examinations consist of the following three exam- 
inations: 


Part 1. Language Aptitude Examination. 


(Reading comprehension, meaning of words and word relationships, antonyms, and 
verbal reasoning.) 


Part 2. General Mathematics Examination. 


(Algebra, trigonometry, coordinate geometry, differential and integral calculus.) 
Part 3. Special Mathematics Examination. 
(Finite differences, probability and statistics.) 


The 1953 Preliminary Actuarial Examinations will be prepared by the Edu- 
cational Testing Service and will be administered by the Society of Actuaries at 
centers throughout the United States and Canada in May 1953. The closing 
date for applications is March 15, 1953. 

Detailed information concerning the Examinations can be obtained from: 

The Society of Actuaries 
208 South LaSalle Street 
Chicago 4, Illinois. 
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New Members 


The following persons have been elected to membership in the Institute 


(March 3 to May 30, 1952) 


Acker, Robert D., B.S. (St. Peters College, Jersey City), Research Assistant in Under- 
writing Studies, Actuarial Division, Metropolitan Life Insurance Company, 1 Madison 
Avenue, New York 10, New York, also Graduate Student at New York University and 
Columbia University. 

Aggarwal, Om P., M.A. (Delhi Univ.), Research Assistant, Department of Statistics, 
Stanford University, Stanford, California. 

Anderson, Sigurd L., B.S.E. (Cornell Univ.), Graduate Student, Department of Experi- 
mental Statistics. North Carolina State College, Raleigh, North Carolina. 

Bell, Charles B., Jr., M.S. (Notre Dame), Research Laboratory Analyst, Operation Design 
Evaluation Group, Engineering Department, Santa Monica Division, Douglas Air- 
craft Company, 1726 W. 24th Street, Los Angeles, California. 

Brewer, Robert A., B.S. (Univ. of Michigan), 12857 Longacre, Detroit 27, Michigan. 

Canu, Jean-Francois, M.Sc. (Univ. of Chicago), Mathematician, B.O.Q., Naval Proving 
Ground, Dahlgren, Virginia. 

Clemans, Kermit G., M.A. (Univ. of Minnesota), Instructor in Mathematics, Department 
of Mathematics, University of Oregon, Eugene, Oregon. 

Cox, Paul C., A.M. (Univ. of New Mexico), Analytic Statistician, White Sands Proving 
Ground, Las Cruces, New Mexico, P. O. Box 43, Las Cruces, New Mexico. 

David, Herbert A., B.Sc. (Sydney, Australia), Graduate Student, University College, 
London, 26 Curzon Road, London, N. 10, England. 

Diamond, Earl L., A.B. (Univ. of Miami), Graduate Student, Department of Mathematical 
Statistics, University of North Carolina, Room 227, Connor Dormitory, Chapel Hill, 
North Carolina. 

Exselsen, Robert M., Ph.B. (Univ. of Chicago), Graduate Student, Department of Mathe- 
matical Statistics, Columbia University, 468 Riverside Drive, New York 27, New York. 

Fosler, Edward A., B.A. (Wayne University, Michigan), Quality Control Engineer, 2206 
John B., Hazel Park, Michigan. 

Gardner, Leland A., Jr., B.A. (Columbia Univ.), Graduate Student, Department of Mathe- 
matical Statistics, Columbia University, New York 27, New York, 3081 Edwin Avenue, 
Apt. 1-E, Fort Lee, New Jersey. 

Gordon, Mary A., Ph.D. (Columbia Univ.), Research Psychologist, United States Air 
Force, Lackland Air Force Base, 128 Main Plaza, San Antonio, Tezas. 

Graybill, Franklin, Ph.D. (Iowa State College), Assistant Professor, Mathematics Depart- 
ment, Oklahoma A. and M. College, Stillwater, Oklahoma. 

Greenberger, Charles B., Student, Wayne University, 18971 Santa Rosa, Detroit, Michigan. 

Guttman, Irwin, B.Sc. (McGill Univ., Canada), Graduate Student, Toronto University, 
16 Sussex Avenue, Toronto, Ontario, Canada. 

Hadden, Elizabeth S., A.B. (Univ. of Mich.), Student, University of Michigan, 413 Belsy 
Barbour, Ann Arbor, Michigan. 

Hall, William J., A.M. (Univ. of Mich.), Research Assistant and Graduate Student, De- 
partment of Mathematical Statistics, Institute of Statistics, University of North 
Carolina, Chapel Hill, North Carolina. 

Hamblen, John W., A.B. (Indiana Univ.), Graduate Assistant and Graduate Student, 
Mathematics Department, Purdue University, West Lafayette, Indiana. 

Harris, Bernard, B.B.A. (City College of New York), Mathematical Statistician, Census 
Bureau, also Graduate Student, George Washington University, Washington 19, D.C. 

Hunter, John S., M.S. (North Carolina State), Graduate Assistant and Graduate Student, 
Institute of Statistics, P.O. Box 5457, College Station, Raleigh, North Carolina. 
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Hurst, Frederick V., Jr., B.S. (Wagner College), Graduate Student, Department of Mathe- 
matical Statistics, Columbia University, New York 27, 82 Van Brunt Street, Staten 
Island 12, New York. 

Kallianpur, Gopinath B., Ph.D. (Univ. of North Carolina), Lecturer and Research As- 
sociate, Statistical Laboratory, University of California, Berkeley 4, California. 
Laurent, Andre. G., Certificate of Probability and Statistics (Paris), Administrator, Insti- 

tute of Statistics and Economies, 1/41 Rue du Ranelagh, Paris XVI, France. 

Lopez, Alvaro, Degree in Engineering (Escuela National de Minas, Colombia, South 
America), Statistician, Asociacion Nacional de Industriales, Medellin, Colombia, 
South America. 

Loural, Edgard de Aimeida, Civil Engineer (Univ. of Brasil), Aircraft Maintenance 
Engineer, Panair of Brasil, Aeroporto Santos Dumont, Rio de Janeiro, Rua Marques 
de Abrantes, 189 Apt. 605, Rio de Janeiro, D.F., Brasil. 

MacKay, John H., M.A. (State Univ. of Iowa), Assistant Professor of Accounting (on leave 
of absence), College of Commerce, Tulane University, New Orleans, (at present) 
Graduate Student, Department of Mathematical Statistics, University of North 
Carolina, 106 Church Street, Chapel Hill, North Carolina. 

Marascuilo, Leonard A., B.A. (Univ. of Minnesota), Student and Teaching Assistant, 
Biostatistics Department, University of Minnesota, 602 North Hazel Street, St. Paul 6, 
Minnesota. 

Marshall, Ross D., M.A. (Univ. of Mich.), Graduate Student, Department of Mathematics, 
University of Michigan, 915 Green St., Ann Arbor, Michigan. 

McAdams, H. T., B.Ed. (Illinois State Normal), Research Chemist, Aluminum Research 
Laboratories, 3300 Missouri Avenue, E. St. Louis, 564 Logan Street, Bethalto, Illinois. 

Mesner, Dale M., M.S. (Northwestern Univ.), Graduate Assistant, Department of Mathe- 
matics, Michigan State College, East Lansing, Michigan. 

Morse, Norman, B.A. (Cornell Univ.), Teaching Assistant and Graduate Student, Statistics 
Department, New York State School of Industrial and Labor Relations, Cornell 
University, Ithaca, New York. 

Ohman, Carl R., B.A. (Knox College), Graduate Student and Assistant in Research, 
Department of Mathematics, Princeton University, Princeton, New Jersey. 

Ortega, Jose A., Agricultural ingineer (Havana Univ.), Economic Adviser of Ministry 
of Commerce of Cuba and Economic Adviser of Cuban’s Works Confederation, Carmen 
No. 157, entre Tenerife y Monte, Havana, Cuba. 

Pachares, James, B.S. (Univ. of Akron), Graduate Student, Department of ).athematical 
Statistics, University of North Carolina, Chapel Hill, North Carolina. 

Pelto, Chester R., M.S. (Penna. State College), Chief, Petrographic Section, M.R.D. 
Laboratory, Corps of Engineers, U. 8. Army, 2008 Spencer Street, Omaha 10, Nebraska. 

Rao, V. K. R. V., Ph.D. (Cambridge Univ.), Dean, Faculty of Social Sciences; Professor 
and Director, Delhi School of Economics, University of Delhi, Delhi 9, India. 

Resnikoff, George J., M.S. (Stanford Univ.), 1054 Myrtle Street, Palo Alto, California. 

Roeloffs, Robert, B.S. (Columbia School of Engineering), Associate Physicist, U. 8. Steel 
Co., Research Laboratory; Graduate Student, Department of Engineering Statistics, 
Columbia University, New York, 38-15 Fifty-second Street, Long Island City 4, New 
York. 

Rohloff, Albert C., M.S. (Purdue Univ.), Teaching Assistant and Graduate Student, De- 
partment of Mathematics, Purdue University, W. Lafayette, Indiana. 

Severo, Norman C., B.A. (Univ. of Buffalo), Graduate Student, Department of Mathe- 
matical Statistics, Porter Hall 119E, Carnegie Institute of Technology, Pittsburgh, 
Pennsylvanza. 

Simmons, Leo D., M.S. (Louisiana State Univ.), Mathematician, Research Department, 
United Gas Corporation, Shreveport 92, Louisiana. 

Smith, F. Beckley, Jr., M.S. (Carnegie Institute of Tech.), Teaching Assistant, Carnegie 

Institute of Technology, 264 Atlanta Drive, Pittsburgh 28, Pennsylvania. 
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Sprott, David, B.A. (Univ. of Toronto), 167 Glen Road, Toronto, Canada. 

Steinberg, Leonard M., B.A. (Univ. of Toronto), Graduate Student, Department of Mathe- 
matics, University of Toronto, 54 St. Patrick St., Toronto 2B, Ontario, Canada. 

Stubbs, Harold L., M.A. (Columbia Univ.), Research Associate, Electronic Research 
Project, Northwestern University, also Graduate Student, Department of Mathe- 
matics, Boston University, 355 So. Main Street, Sharon, Massachusetts. 

Terzuoli, Andrew J., M.S. (New York Univ.), Instructor, Department of Mathematics, 
Polytechnic Institute of Brooklyn, 85 Livingston Street, Brooklyn 2, New York. 
Tung, Lloyd H., B.A. (Lingnan Univ.), Graduate Student, Department of Mathematics, 
University of Michigan, 6621 Gomberg, South Quadrangle, Ann Arbor, Michigan. 
Walter, John R., B.A. (Univ. of Toronto), Graduate Student, Department of Mathematics, 

Division of Actuarial Science, University of Toronto, 8 Norma Cres., Toronto, Ontario, 
Canada. 
Weiss, Irving, M.A. (Columbia Univ.), Graduate Student, Department of Statistics, 
Stanford University, Building 415, Apt. 2, Stanford Village, Stanford, California. 
Whittlesey, John R. B., M.S. (Calif. Inst. of Tech.), Graduate Student, Department of 
Mathematical Statistics, University of North Carolina, 2/0 Ransom Street, Chapel 
Hill, North Carolina. 

Wiggins, Alvin D., A.B. (Univ. of Calif.), Graduate Student, Department of Mathematics, 
University of California, Berkeley, 4100 Day Ave., Apt. 2C, Richmond 6, California. 
Zelen, Marvin, M.A. (Univ. of N. Carolina), Mathematical Statistician, Stevens Institute 

of Technology, 67-60 150th St., Kew Gardens Hills 67, New York. 


rr 


REPORT OF THE EUGENE MEETING OF THE INSTITUTE 


The fifty-second meeting of the Institute of Mathematical Statistics was 


held at the University of Oregon, June 19-21, 1952, in conjunction with the 
annual meeting of the Biometric Society, WNAR, the Eugene meetings of the 
Econometric Society, the Western Regional meeting of the American Mathe- 
matical Society and the Pacific Northwest meeting of the Mathematical Associa- 
tion of America. One hundred seventy-three persons registered, including the 
following members of the Institute: 


C. B. Allendoerfer, Hjalmar Anderson, Jr., G. A. Baker, B. M. Bennett, C. A. Dennett, 
Mrs. C. A. Bennett, Z. W. Birnbaum, Jack Borsting, A. H. Bowker, Bernice Brown, D. G. 
Chapman, K. G. Clemans, I. L. Cox, E. L. Crow, G. B. Dantzig, R. C. Davis, W. J. Dixon, 
Robert Dorfman, Mary Elveback, E. A. Fay, R.S. Gardner, M. A. Girshick, C. H. Gordon, 
Margaret Gurney, K. D. C. Haley, W. C. Healy, Jr., H. M. Hughes, Mark Kac, R. B. 
Leipnik, J. C. R. Li, G. J. Lieberman, Eugene Lukaes, F. J. Massey, Jr., Paul Meyer, R. 
H. Moore, Sigeiti Moriguti, W. L. Nicholson, Donald Owen, Edward Paulson, Bayard 
Rankin, G. J. Resnikoff, Herman Rubin, Whitney Scobert, Paul Simpson, W. B. Simpson, 
Rosedith Sitgreaves, Andrew Sobezyk, D. Teichroew, F. H. Tingey, R. H. Titman, Eliza- 
beth Vaughan, L. H. Wegner, Irving Weiss. 


The opening session on Thursday morning was on Stochastic Models. Professor 
M. A. Girshick, Stanford University was chairman. The speakers and their 
subjects were: 





1 
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. The Auditory Corter—A Probability Model. Archie R. Tunturi, University of Oregon 


Medical School. 


. Testing Message Diffusion: The Utilization of Mathematical Models. Stuart C. Dodd, 


Richard J. Hill, and Susan Huffaker, University of Washington. 


This was followed by two invited addresses. Professor Frank J. Massey, Jr., 
University of Oregon presided. The papers were: 


3 


. On the Method of Collective Marks. Herman Rubin, Stanford University. 


4. On Asymptotic Properties of Estimates. Lucien LeCam, University of California, 


Berkeley. 


On Friday afternoon Professor Albert H. Bowker, Stanford University presided 


at a 


session at which the following contributed papers were presented: 


. The Principle of Invariance Applied to a Problem of Classification. Rosedith Sit- 
greaves, Stanford University. 


2. Optimum selection procedures. Edward Paulson, University of Washington. 


. A Theorem on Conver Cones with Applications to Linear Inequalities. Jerry 
W. Gaddum, Institute for Numerical Analysis. 

. On the Prediction of Nonstationary Stochastic Processes. R. C. Davis, Bureau of 
Ordnance. 

. Power Efficiency Function for Normal Alternatives for Several Nonparametric Tests. 
W. J. Dixon, University of Oregon. 

. Bounds for Second Moments of the Sample Range. Sigeiti Moriguti, University of 
North Carolina and University of Tokyo. 

. Estimates, Tests, and Tolerance Intervals for Lump Data from a Normal Distribution. 
Harry M. Hughes, University of California, Berkeley. 


. A Computing Formula for the Power of the Two-sided t-test for Even Degrees of Freedom. 


Wesley L. Nicholson, University of Oregon. 


. On the Analysis of Data Matched in Pairs. (By title.) Frank J. Massey, Jr., Uni- 


versity of Oregon. 


. The Power Function of the Haldane-Smith Test. (By title.) B. M. Bennett, University 


of Washington. 


. Spectral Analysis of Stationary Time Series. Preliminary Report. (By title.) Ulf 


Grenander and Murray Rosenblatt, University of Chicago. 


2. Asymptotically Subminimaz and Asymptotically Admissible Statistical Decision Pro- 


14. 


15. 


16. 


17 


cedures. (By title.) Jack Laderman, Columbia University. 
. Note on the Problem of Combining Independent Tests of Significance. (By title.) Allan 
Birnbaum, Columbia University. 
On Judging all Contrasts in the Analysis of Variance. Preliminary report. (By title.) 
Henry Scheffé, Columbia University. 
Further Moving Average Methods in the Estimation of LD-50. (By title.) B. M. Bennett, 
University of Washingtvn. 
Nonparametric Theory: Confidence Regions and Tests for Location and Scale Parameters. 
Preliminary Report. (By title.) D. A. 8S. Fraser, University of Toronto. 
. Random Functions Satisfying Certain Linear Relations. I. (By title.) 8. G. Ghurye, 
University of North Carolina. 


Professor Robert Dorfman, University of California presided at the opening 
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session Friday. This session was devoted to Developments in Linear Programming 
and the following papers were presented: 


1. Computational Experience in Solving Linear Programs. A. J. Hoffman, National 
Bureau of Standards. 

2. Duality of Multi-valued Means. Theodore 8. Motzkin, University of California, Los 
Angeles. 

3. A Note ona Dynamic Leontief Model with Substitution. George B. Dantzig, The Rand 
Corporation. 


Later in the morning following an address of welcome to the University by 
President Harry K. Newburn, Professor Mark Kac, Cornell University, presented 
an address titled On Some Discrete Non-Markovian Processes. 

Friday afternoon Professor Mary Elveback, University of California, Los 
Angeles, presided at a session at which the following contributed papers were 
presented. 


1. Confidence Intervals on the Slopes of Regression Lines when both Variables Are Subject 
to Error. C. O. Junge, Jr., University of Washington. 

2. Statistical Estimation from Time and Population Samples. Julius A. Jahn, Washing- 
ton State College. 

3. The Analysis of Samples from Mixed Populations. Preliminary Report. D. G. Chap- 
man, University of Washington. 

4. Some Applications of the Log-Normal Distribution to the Study of Survival Times in 
Chronic Fatal Diseases, Particularly Leukemia. Harold Tivey, University of Oregon 
Medical School. 

. Field Trial Problems. G. A. Baker, University of California, Davis. 

6. Population Forecasts, State of Washington, 1950-1960: Methodological Summary. 
Calvin F. Schmid, Vincent A. Miller and Warren E. Kalbach, University of Wash- 
ington. 

7. On the Addition of Chi-squares. Preliminary Report. Jack Borsting, University of 
Oregon. 


on 


On Saturday morning Professor Paul B. Simpson, University of Oregon 
presided at a session on Decision Theory at which the following three papers 
were presented : 


1. Decisions Based on Incomplete Information. Norman Dalkey, The Rand Corporation. 

2. Method of Synthesizing an Autonomous Shipbuilding Industry for an Interindustry 
Input-Output Model. Captain J. E. Hamilton, George Washington University. 

3. A Mathematical Model of the Shipbuilding Industry. R. F. Williams, George Wash- 
ington University. 


Saturday afternoon, Professor Z. W. Birnbaum, University of Washington 
presented a Special Invited Paper, Distribution-free Tests of Fit for Continuous 
Distribution Functions. Professor D. G. Chapman, University of Washington, 
presided. 

The final session was on Inspection Sampling. Professor Albert Bowker, 
Stanford University, was chairman and the following papers were presented: 

1. Acceptance Inspection by Variables when the Measurements Are Subject to Errors with 


Known Variance. Edward A. Fay and John E. Walsh, U. 8S. Naval Ordnance Test 
Station, China Lake. 









































PUBLICATIONS RECEIVED 491 


2. A Two-sided Criterion for Acceptance Inspection by Variables. Edwin L. Crow, U. 8. 
Naval Ordnanee Test Station, China Lake. 
3. Acceptance Inspection by Variables in the Presence of Measurement Error. Edward A. 
Fay U.S. Naval Ordnance Test Station, China Lake. 
. On Continuous Inspection Plans. Preliminary Report. Gerald J. Lieberman, Stanford 
University. 
. An Acceptance Procedure with Two-sided Specification Limits. George J. Resnikoff, 
Stanford University. 


Social events included a banquet sponsored by the mathematical organizations, 
followed by an open house at the Faculty Club Friday evening. 


W. J. Drxon 
Assistant Secretary 
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PUBLICATIONS RECEIVED 


Apruzz1, ApAM, Work Measurement, Columbia University Press, New York, 1952, xviii + 
290 pp., $6.00. 

Me ttzer, Hans, Wahrheit und Wahrscheinlichkeit in der Statistik, Wirtschaftschochschule 
Mannheim, 1952, iv + 35 pp. 

Quaderni dell’ Istituto di Scienze Economiche e Statistiche, xiv, Universita degli Studi di 
Milano, Milan, 1951, iv + 52 pp., L. 400. 

Recenseamento Geral do Brasil (1° de Setembro de 1940) Censo Demogrdfico and Censos 
Econdémicos, Servico Grdfico de Instituto Brasileiro de Geogrdfia e Estatistica, Rio de 
Janeiro, 1950, 12 volumes in addition to those listed in March, 1952. 

Statistical Method in Industrial Production, (Papers given at a Conference held in Sheffield 
in 1950), Royal Statistical Society, London, 1951, v + 89 pp., 7 shillings and sixpence. 

Wavan, ALBERT E., Elements of Statistical Method, McGraw-Hill, New York, 1952, xv + 
531 pp., $5.50 













ESTADISTICA 


Journal of the Inter American Statistical Institute 


Vol. X, No. 36 September 1952 
Contents 


Estadistica No. 36 is an experimental “subject issue,’ devoted almost in its 
entirety to: 
STATISTICAL TEACHING AND TRAINING 
METHODS AND MATERIALS 


This number was developed primarily to provide a collection of useful viewpoints and 
important reference materials which would be of particular value to statistical teach- 
ing and training activities in the Western Hemisphere—whether conducted in uni- 
versities, in government statistical operating agencies, or elsewhere. The contents fall 
roughly into five categories: (1) Problems and needs in statistical education; (2) 
how the needs can be met; (3) examples of curricula and operational methods; (4) 
reports and other documentary material; and (5) bibliography. 

The material is published under three separate covers—the main Journal, consisting 
of approximately 170 pages, in which articles in their original text appear; Supplement 
No. 1, consisting of approximately 120 pages of translations of articles or reports, and 
of other documentary material; and Supplement No. 2, containing a 50-page Bibli- 
ography of Statistical Textbooks and Other Teaching Material, prepared under the 
auspices of the Committee on Statistical Education of IASI. 

Among contributors to issue No. 36 are the following: FRANCISCO DE ABRISQUETA, 
Car os E. Drev.erait, HALBERT L. Dunn, Forrest E. Linper, M. PEREZ GUERRERO, 
Stuart A. Rice, Luis THorrn Casas, SAMUEL S. WILKs, and others. 


Published quarterly; annual subscription price $3.00 (U.S.); single copies $1.00 (U.S.) 
Inter American Statistical Institute, % Pan American Union, Washington 6, D.C., U. S. A. 


JOURNAL OF THE June 1952 
AMERICAN STATISTICAL ASSOCIATION Vol. 47 No. 258 


1108 16th Street, N. W., Washington 6, D. C. 


An Analysis of Some Failure Data. . ...D. J. Davis 
Classification and Analysis of Partially Balanced Incomplete Block Designs with Two Asso- 
ciate Classes ....R. C. Bose anp T. Sammanoto 
Replacing Variables in Correlation Problems Vincent I. West 
Operating Characteristics for Tests of the Stability of a Normal Population Joun E. WALsH 
Multiple Sampling of Attributes D.$. Rosson AND A. J. KinG 
Estimating the Product of Several Random Variables..... . G. D. SHELLARD 
Some Principles of Processing Census and Survey Data 
Rosert B. VoiGut AND MARTIN KRIESBERG 
Short-cut Methods of Estimating County Population Rosert C. Scumitt 
Sampling Surveys in Central Africa ‘ é J. R. H. SHavr 
Factors in the Accumuiation of Social Statistics SOLOMON FABRICANT 
Comparison of Selected Measures of Ability of Communities to Bear Tax Burdens 
Lorin A. THOMPSON 
A Critical Evaluation of Available Agricultural Statistics... ; ..... Ivan M. LEE 
Prepaid Medical Care as a Source of Morbidity Data.... NEVA R. DEARDORFF 
Some Cases in Which Yates’ Correction Should not be Applied............Epwmy L. Crow 


The American Statistical Association invites as members all per- 


sons interested in: 
1. development of new theory and method 
2. improvement of basic statistical data 
3. application of statistical methods to practical problems. 





BIOMETRIKA 
A Journal for the Statistical Study of Biological Problems 
Volume 39 Contents Parts 3 and 4, December 1952 


1, Estimation of population parameters from data obtained by means of capture-recapture method. Part II. 
By P. H. LESLIE. 2. Tensor notation and the sampling cumulants of k-statistics. By E. L. KAPLAN. 
3. Estimation in double sampling. By D. R. COX. 4. Sampling from bivariate, mon-normal universes. 
By H. HYRENIUS. 5. The truncated Poisson distribution. By P. G. MOORE. 6. Upper 5% and 1% 
points of the ratio s*max/s*min. By H. DAVID. 7. Conditions under which Gram-Charlier and Edge- 
worth curves are positive definite and unimodal. By D. E. BARTON and K. E. DENNIS. 8. Ona two- 
sided sequential t-test. By 8S. RUSHTON. 9. Properties of distribution based on certain simple trans- 
formation of the normal curve. By J. DRAPER. 10. Estimation of the mean and standard deviation of 
a normal population from a censored sample. By A. K. GUPTA. 11. The rank analysis of incomplete 
block designs. By R. A. BRADLEY and M. E. TERRY. 12. The statistical structure of ecological com- 
munities. By J. G. SKELLAM. 13. The growth, survival, wandering and variation of the long-tailed 
field mouse. Part I[1I—Wandering and recapture. By H. P. and H. 8. HACKER. 14. Use of scores for 
the analysis of association in contingency tables. By E. J. WILLIAMS. 15. Statistical significance of odd 
bits of information. By M. 8. BARTLETT. 16. Tests of fit in time series. By P. WHITTLE. 17. The 
fitting of grouped truncated and grouped censored normal distributions. By P. M. GRUNDY. 18. MIS- 
CELLANEA: Samples with the same number in each stratum. By W. L. STEVENS. Comparison of 
analysis of variance power functions in the parametric and random models. By N.L.JOHNSON. Approxi- 
mation to the probability integral of the distribution of range. By N. L. JOHNSON. Discrimination in 
time series analysis. By A. RUDRA. Statistical control of counting experiments. By H. O. LAN- 
CASTER. Exact grouping corrections to moments and cumulants. By M. KUPPERMAN. 


The subscription price, payable in advance, is 45s. inland, 54s. export (per volume including postage). Cheques 
should be drawn to Biometrika and sent to “The Secretary, Biometrika Office, Department of Statistics, 


University College, London, W.C. 1.” All foreign cheques must be in sterling and drawn on a bank 
having a London agency. 


ECONOMETRICA 


Journal of the Econometric Society 
Contents of Vol. 20, July, 1952, include: 


JAN TINBERGEN 

Four Alternative Policies to Restore Balance of Payments Equilibrium 
T. M. Brown ....Habit Persistence and Lags in Consumer Behavior 
AE. Ret... saree Safety First and the Holding of Assets 
WALTER IsaRD A General Location Principle of an Optimum Space-Economy 
RENE Roy Les Elasticites 

de la Demande relative aux biens de Consommation et aux groups de biens 

A. Dvoretzky, J. KigreR, AND J. WoOLFOWITZ 

The Inventory Problem: II. Case of Unknown Distributions of Demand 
Reports of the Boston and Tokyo Meetings 
Review Articles, Book Reviews, and Notes 


Published Quarterly Subscription rates available on request 
The Econometric Society is an international society for the advancement of economic theory in its 
relation to statistics and mathematics 
Subscriptions to Econometrica and inquiries about the work of the Society and the procedure in applying 


for membership should be addressed to William B. Simpson, Secretary, The Econometric Society, The 
University of Chicago, Chicago 37, Illinois, U. S. A. 











MATHEMATICAL REVIEWS 


A journal containing reviews of the mathematical liter- 
ature of the world, with full subject and author indices 


Publication of this journal is sponsored by the American Mathe- 
matical Society, Mathematical Association of America, Institute of 
Mathematical Statistics, London Mathematical Society, Edinburgh 
Mathematical Society, Union Matematica Argentina, and others. 


Subscriptions accepted to cover the calendar year only. 
Issues appear monthly except July. $20.00 per year. 


Send subscription order or request for sample copy to 


AMERICAN MATHEMATICAL SOCIETY 
80 Waterman Street, Providence 6, Rhode Island 


JOURNAL OF THE 
ROYAL STATISTICAL SOCIETY 


Series B (Methodological) 
Contents of Volume 13, No. 2, 1951 


Ee er Pee Some Problems in the Theory of Queues 
H. E. Danrets....................The Theory of Position Finding. (With Discussion) 
W. R. Bucktanp..................A Review of the Literature of Systematic Sampling 
V. P. GODAMBE. . dint 6 ed nee 680i b a8 dsa. a 4k wane pn 9 
B. V. SuxHatme...On Certain Probability Distributions Arising from Points on a Line 
P. G. Guest..The Estimation of Standard Error from Successive Finite Differences 
E. H. Smarson........ ... The Interpretation of Interaction in Contingency Tables 
H. O. PATTERSON... . . .Complex Contingency Tables Treated by the Partition of x? 
S. RosenBauM......The Variance of Least-Square Estimates under Linear Restraint 
Se ARNO, os omer cvnscaret cones pits aw 00d downs + 6010 69:9 
P. M. Grunpy 
A General Technique for the Analysis of Experiments with Incorrectly Treated Plots 
D. J. Froyney. .Subjective Judgment in Statistical Analysis: An Experimental Study 
G. H. Jowett The Expression of the Complementary 
Outputs of Two Products in Terms of a Common Unit of Production Effort 
J. Durr anv A. STUART.......... .Inversions and Rank Correlation Coefficients 
H. E. DaNIELs... Note on Durbin and Stuart’s Formula for E(r,) 


The Royal Statistical Society, 4, Portugal Street, London, W.C.2. 





SKANDINAVISK 
AKTUARIETIDSKRIFT 


1951 - Parts 3 - 4 
Contents 


G. ARFWEDSON 
A Probability 
Distribution Connected with Stirling’s Second Class Numbers 
T. DaLentius AND M. GurRNEY The Problem of Optimum Stratification. IT. 
HERMAN WOLD Demand Functions and the Integrability Condition 
G. HarBitTz Post-war Mortality among Industrial Insured Lives in Norway 


S. Vaspa Analytical Studies in Stop-Loss Insurance 
Knut MEDIN 


The Sickness Experience of the Valkyrian Insurance Company, 1929-1948 
PER OTrEsTaD 


On the Test of the Hypothesis 
that the Probability of an Event Is Contained within Given Limits 


Annual subscription: 10 Swedish Crowns (Approx. $2.00). 
Inquiries and orders may be addressed to the Editor. 
SKARVIKSVAGEN 7, DJURSHOLM (SWEDEN) 


SANKHYA 


The Indian Journal of Statistics 
Edited by PC. Mahalanobis 


Vol. ul, Part 2, 1951 


The Estimation of Parameters in Certain Stochastic Processes Henry B. MAnn 
Statistical Inference Applied to Classificatory Problems C. RADHAKRISHNA Rao 
Multivariate Binomial and Poisson Distributions A. 8. KrISHNAMOORTHY 
On Errors of Estimates in Various Types of Double Sampling Procedure. .K. C. SEAL 
Estimation of Parameters from lacemplete Data with Application to Design of 
Sample Surveys ay ABRAHAM MATTHAI 
Confluent Hypergeometric Function PRan Nata 
A Study of Recent Trend in Infantile Mortality Rates in Calcutta by Longitudinal 
Survey K. N. Mrrra, B. Buarracnarya, K. Dey, C. S. Dawn, 
M. OBADIAH, anp A. K. GavEen 

On the Non-Existence of Certain Difference Sets for Incomplete Group Designs 


S. S. SHRIKHANDE 
On the Non-Existence of Affine Resolvable Balanced Incomplete Block Designs 


: S. S. SHRIKHANDE 
A Note on the Power of the Best Critical Region for Increasing Sample Size 


D. Basu 
Some Further Results on Errors in Double Sampling Technique. ...CHAMELI Bose 
A Note on Price-Wage Variations in Cottage and Factory Economy. .G. C. MANDAL 


Annual! subscription: 30 rupees 
Inquiries and orders may be addressed to the 
Editor, Sankhy&, Presidency College, Calcutta, India. 
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